-- Logs begin at Thu 2021-10-28 08:47:16 UTC, end at Thu 2021-10-28 10:09:49 UTC. -- Oct 28 09:39:11.517991 dv-cinder-815712-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 28 09:39:11.532448 dv-cinder-815712-3-iscsi devstack@n-api.service[108061]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 28 09:39:11.535052 dv-cinder-815712-3-iscsi devstack@n-api.service[108061]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 28 09:39:11 2021] *** Oct 28 09:39:11.535052 dv-cinder-815712-3-iscsi devstack@n-api.service[108061]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 28 09:39:11.535052 dv-cinder-815712-3-iscsi devstack@n-api.service[108061]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 28 09:39:11.535052 dv-cinder-815712-3-iscsi devstack@n-api.service[108061]: nodename: dv-cinder-815712-3-iscsi Oct 28 09:39:11.535052 dv-cinder-815712-3-iscsi devstack@n-api.service[108061]: machine: x86_64 Oct 28 09:39:11.535052 dv-cinder-815712-3-iscsi devstack@n-api.service[108061]: clock source: unix Oct 28 09:39:11.535052 dv-cinder-815712-3-iscsi devstack@n-api.service[108061]: pcre jit disabled Oct 28 09:39:11.535052 dv-cinder-815712-3-iscsi devstack@n-api.service[108061]: detected number of CPU cores: 4 Oct 28 09:39:11.535052 dv-cinder-815712-3-iscsi devstack@n-api.service[108061]: current working directory: / Oct 28 09:39:11.535052 dv-cinder-815712-3-iscsi devstack@n-api.service[108061]: detected binary path: /usr/bin/uwsgi-core Oct 28 09:39:11.535052 dv-cinder-815712-3-iscsi devstack@n-api.service[108061]: your processes number limit is 47680 Oct 28 09:39:11.535052 dv-cinder-815712-3-iscsi devstack@n-api.service[108061]: your memory page size is 4096 bytes Oct 28 09:39:11.535052 dv-cinder-815712-3-iscsi devstack@n-api.service[108061]: detected max file descriptor number: 2048 Oct 28 09:39:11.535052 dv-cinder-815712-3-iscsi devstack@n-api.service[108061]: lock engine: pthread robust mutexes Oct 28 09:39:11.535052 dv-cinder-815712-3-iscsi devstack@n-api.service[108061]: thunder lock: enabled Oct 28 09:39:11.535052 dv-cinder-815712-3-iscsi devstack@n-api.service[108061]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 28 09:39:11.535052 dv-cinder-815712-3-iscsi devstack@n-api.service[108061]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 28 09:39:11.578918 dv-cinder-815712-3-iscsi devstack@n-api.service[108061]: Python main interpreter initialized at 0x5638f1f259c0 Oct 28 09:39:11.578918 dv-cinder-815712-3-iscsi devstack@n-api.service[108061]: python threads support enabled Oct 28 09:39:11.578918 dv-cinder-815712-3-iscsi devstack@n-api.service[108061]: your server socket listen backlog is limited to 100 connections Oct 28 09:39:11.578918 dv-cinder-815712-3-iscsi devstack@n-api.service[108061]: your mercy for graceful operations on workers is 90 seconds Oct 28 09:39:11.579294 dv-cinder-815712-3-iscsi devstack@n-api.service[108061]: mapped 403077 bytes (393 KB) for 2 cores Oct 28 09:39:11.579391 dv-cinder-815712-3-iscsi devstack@n-api.service[108061]: *** Operational MODE: preforking *** Oct 28 09:39:11.579623 dv-cinder-815712-3-iscsi devstack@n-api.service[108061]: *** uWSGI is running in multiple interpreter mode *** Oct 28 09:39:11.579623 dv-cinder-815712-3-iscsi devstack@n-api.service[108061]: spawned uWSGI master process (pid: 108061) Oct 28 09:39:11.579957 dv-cinder-815712-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 28 09:39:11.584678 dv-cinder-815712-3-iscsi devstack@n-api.service[108061]: spawned uWSGI worker 1 (pid: 108062, cores: 1) Oct 28 09:39:11.584678 dv-cinder-815712-3-iscsi devstack@n-api.service[108061]: spawned uWSGI worker 2 (pid: 108063, cores: 1) Oct 28 09:39:11.584678 dv-cinder-815712-3-iscsi devstack@n-api.service[108061]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 28 09:39:13.275796 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 09:39:13.275796 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: from cryptography.utils import int_from_bytes Oct 28 09:39:13.276483 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 09:39:13.276483 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: from cryptography.utils import int_from_bytes Oct 28 09:39:13.278131 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 09:39:13.278131 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: from cryptography.utils import int_from_bytes Oct 28 09:39:13.278742 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 09:39:13.278742 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: from cryptography.utils import int_from_bytes Oct 28 09:39:16.026830 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 09:39:16.028333 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 09:39:16.028333 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 09:39:16.028736 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 09:39:16.038329 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 09:39:16.038329 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.038329 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.038329 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.038329 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.038329 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.038329 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.038329 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.039244 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.039244 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.039244 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.039244 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.039244 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815712-3-iscsi {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.039760 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 09:39:16.040412 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.040513 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 09:39:16.040622 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.040779 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 09:39:16.040884 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.041047 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 09:39:16.041233 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.041350 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 09:39:16.041449 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.041563 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.041700 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.041813 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.041907 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.041995 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.042067 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.042178 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.042178 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.042326 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.042397 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.042468 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.042561 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.042639 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.042714 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.042780 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.042845 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.042925 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.042996 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.043137 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.043265 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.043352 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.043429 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815712-3-iscsi {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.043505 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.043575 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.043652 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.043718 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.043782 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.043858 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.043924 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815712-3-iscsi {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.044022 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.044104 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.044170 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.044240 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.044311 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.044384 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.044459 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.044530 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.044530 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.044696 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.044797 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.044878 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.044973 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.045053 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.045125 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.045196 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.045269 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.045344 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.045418 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.045482 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.045563 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.045634 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.045710 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.045781 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.045781 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.045925 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.045925 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.046054 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.046124 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.046198 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.046273 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.046350 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815712-3-iscsi {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.046423 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.046488 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.046560 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.046637 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.046713 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.046798 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.046865 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.046865 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.046994 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.047081 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.047149 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.047219 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.047285 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.047348 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.047425 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.047500 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.047573 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.047644 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.047722 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.047797 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.047961 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.048037 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.048109 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.048181 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.048247 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.048323 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.048390 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.048460 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.048531 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.048596 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.048973 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.049947 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.050046 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.050138 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.050218 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.050306 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.050306 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.050459 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.050546 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.050626 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.050626 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.050785 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.050865 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.050956 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.051052 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.051139 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.051270 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.051409 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.051494 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.104 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.051584 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.051712 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.104 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.051854 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.051998 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.052094 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.052312 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.052409 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.052625 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.052774 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.052951 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.053057 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.053252 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.053350 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.053552 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.053640 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.053852 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.053953 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.054151 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.054239 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.054448 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.054534 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.054745 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.054845 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.055044 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.055131 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.055355 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.055487 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.055626 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.055764 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.055898 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.056032 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.056163 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.056319 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.056449 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.056631 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.056838 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.057038 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.104 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.057175 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.057303 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.104 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.057437 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.057570 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.057702 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.057899 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.058036 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.058200 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.058337 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.058499 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.058627 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.058826 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.058937 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.059141 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.059286 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.059422 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.059596 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.059894 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.060036 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.060218 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.060366 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.060606 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.060773 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.061059 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.061229 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.061389 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.061666 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.061795 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.061969 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.062100 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.062274 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.062540 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.062677 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.062875 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.063014 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.063179 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.063448 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.063618 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.063791 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.063977 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.064117 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.064346 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.064482 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.064738 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.064871 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.064996 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.065296 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.065427 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.065608 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.065752 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.065902 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.066042 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.066267 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.066395 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.066577 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.066882 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.067009 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.067190 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.067441 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.067577 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.067783 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.067924 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.068084 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.068240 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.068487 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.068619 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.068824 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.068957 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.069160 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.069297 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.069471 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.069772 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.069911 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.070072 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.070203 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.070386 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.070517 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.070686 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.070825 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.070986 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.071116 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.071303 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.071441 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.071603 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.071748 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.071905 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.072034 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.072214 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.072349 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.072515 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.072707 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.072881 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.073194 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.073322 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.073489 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.073791 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.073929 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.074100 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.074906 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.075046 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.075314 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.075494 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.075716 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.075973 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.076279 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.076415 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.076600 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.076845 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.076984 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.077117 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.077254 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.077387 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.077520 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.077655 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.077788 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.077913 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.078107 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.078238 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.078470 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.078745 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.078876 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.079071 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.079334 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.079476 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.079677 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:16.079819 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.080009 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.080147 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.080331 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.080467 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.080692 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.080827 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.080986 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.081117 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.081303 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.081434 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.081629 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.081865 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.084325 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.084462 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.084591 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.084901 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.085078 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.085218 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.085362 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.085491 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.085652 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.085805 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.085948 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.086083 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.086212 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.086345 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.086473 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.086612 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.086742 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.086869 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.087003 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.087130 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.087263 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.087399 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.087533 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.087661 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.087787 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.087920 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.088047 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.088185 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.088313 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.088449 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.088575 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.088734 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.088864 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.089009 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.089137 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.089274 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.089408 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.089534 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.089669 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.089798 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.089923 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.090652 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.090839 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.091027 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.091238 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.091464 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.091639 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.091766 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.091901 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.092034 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.092171 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.092298 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.092430 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.092576 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.092721 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.092721 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.092987 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.093120 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.093247 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.093384 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.093510 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.093644 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.093771 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.093897 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.094024 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.094150 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.094275 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.094410 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.094537 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.094663 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.094788 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.094925 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.095060 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.095199 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.095327 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.095453 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.095588 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.095773 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.095892 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.096027 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.096155 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.096264 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.096369 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.096476 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.096591 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.096747 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.096880 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.097006 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.097133 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.097259 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.097397 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.097532 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.097659 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.097785 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.097910 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.098035 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.098171 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.098297 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.098423 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.098549 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.098674 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.098800 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.098939 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.099074 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.099214 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.099386 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.099539 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.099660 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.099787 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.099914 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.100039 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.100165 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.100300 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.100506 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.100643 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.100800 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.100935 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.101061 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.101187 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.101324 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.101459 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.101586 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.101711 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.101837 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.101962 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.102100 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.102227 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.102354 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.102507 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.102634 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.102789 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.102919 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.103052 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.103178 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.103304 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.103432 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.103566 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.103701 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.103835 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.103969 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.104096 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.104229 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.104365 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.104502 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.104629 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.104774 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.104902 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.105040 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.105175 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.105310 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.105437 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.105601 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.105787 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.106085 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.106085 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.106298 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.106298 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.106597 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.106705 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.106841 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.106976 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.107103 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.107229 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.107354 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.107479 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.107604 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.107730 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.107893 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.108008 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.108134 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.108287 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.108425 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.108552 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.108728 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.108848 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.108955 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.109129 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.109260 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.109442 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.109559 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.109775 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.109905 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.110105 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.110249 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.110409 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.110538 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.110716 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.110848 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.111019 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.111148 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.111330 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.111461 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.111634 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.111764 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.111938 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.112075 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.112242 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.112369 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.112544 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.112688 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.112880 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.113010 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.113184 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.113322 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.113483 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.113620 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.113792 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.113921 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.114108 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.114250 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.114412 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.114551 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.114730 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.114866 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.115028 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.115158 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.115334 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.115471 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.115645 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.115795 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.116008 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.116139 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.116312 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.116451 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.116623 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.116807 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.116934 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.117042 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.117249 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.117380 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.117552 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.117674 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.117859 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.117989 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.118161 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.118292 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.118462 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.118592 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.118767 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.118894 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.119078 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.119208 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.119374 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.119502 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.119677 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.119813 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.119975 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.120107 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.120284 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.120414 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.120585 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.120733 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.120910 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.121051 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.121200 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.121830 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.122022 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.122228 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.122434 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.122693 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.122693 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.122974 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.123101 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.123237 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.123366 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.123491 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.123697 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.123841 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.123968 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.124104 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.124231 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.124379 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.124514 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.124642 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.124819 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.124964 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.125122 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.125253 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.125426 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.125565 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.125753 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.125885 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.126064 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.126194 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.126347 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.126493 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.126659 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.126866 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.126996 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.127179 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.127309 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.127500 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.127641 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.127804 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.127933 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.128109 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.128238 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.128408 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.128618 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.128812 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.128939 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.129064 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.129189 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.129329 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.129456 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.129618 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.129771 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.129928 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.130062 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.130232 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.130369 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.130546 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.130684 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.130849 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.130980 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.131156 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.131281 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.131459 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.131590 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.131749 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.131884 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.132047 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.132177 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.132356 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.132493 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.132809 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.132997 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.133137 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.133270 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.133404 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.133574 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.133750 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.134021 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.134158 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.134284 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.134410 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.134535 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.134785 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.134911 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.135230 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.135366 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.135493 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.135619 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.135745 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.135880 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.136009 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.136262 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.136399 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.136537 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.136737 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.136891 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.137591 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.137774 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.137978 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.138204 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.138204 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.138548 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.138683 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.138808 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.138966 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.139096 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.139282 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.139420 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.139600 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.139737 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.139916 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.140044 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.140246 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.140383 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.140571 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.140736 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.140905 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.141033 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.141209 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.141347 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.141519 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.141649 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.141823 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.141978 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.142172 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.142311 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.142476 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.142605 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.142777 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.142905 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.143078 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.143207 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.143436 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.143576 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.143743 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.143871 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.144045 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.144224 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.144355 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.144560 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.144758 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.144979 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.145120 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.145298 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.145436 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.145598 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.145727 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.145906 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.146042 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.146208 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.146344 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.146533 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.146661 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.146840 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.146967 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.147140 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.147276 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.147438 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.147567 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.147737 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.147878 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.148076 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.148204 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.148377 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.148518 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.148734 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.148884 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.149063 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.149205 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.149401 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.149538 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.149703 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.149845 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.150001 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.150128 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.150309 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.150436 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.150607 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.150744 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.150903 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.151031 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.151199 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.151325 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.151503 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.151633 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.151804 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.151930 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.152099 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.152233 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.152401 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.152569 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.153133 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.153340 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.153487 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.153598 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.153825 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.154028 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.154160 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.154293 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.154425 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.154559 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.154694 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.154829 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.154954 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.155078 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.155209 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.155597 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.155725 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.155851 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.155975 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.156122 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.156259 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.156394 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.156520 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.156643 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.156798 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.156924 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.157047 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.157194 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.157320 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.157444 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.157575 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.157707 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.157845 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.157974 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.158106 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.158229 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.158353 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.158476 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.158609 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.158778 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.158949 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.159079 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.159261 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.159389 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.159586 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.159722 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.159897 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.160035 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.160196 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.160331 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.160495 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.160625 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.160817 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.160947 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.161115 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.161262 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.161400 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.161528 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.161706 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.161835 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.162009 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.162137 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.162308 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.162439 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.162607 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.162737 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.162904 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.163044 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.163199 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.163326 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.163498 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.163613 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.163795 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.163936 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.164097 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.164236 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.164394 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.164523 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.164779 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.164936 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.165072 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.165199 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.165360 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.165528 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.165669 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.165796 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.165956 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.166087 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.166269 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.166420 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.166559 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.166686 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.166870 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.167000 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.167275 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.167419 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.167557 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.167684 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.167818 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.168240 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.168395 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.168934 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.169271 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.169403 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.169531 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.169657 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.169782 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.169918 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.170052 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.170180 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.170313 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.170441 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.170568 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.170693 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.170809 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.170944 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.171082 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.171215 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.171341 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.171479 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.171607 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.171740 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.171874 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.172018 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.172159 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.172296 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.172423 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.172550 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.172703 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.172833 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.172959 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.173099 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.173248 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.173378 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.173523 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.173732 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.173871 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.174032 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.174163 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.174336 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.174466 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.174646 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.174789 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.174952 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.175082 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.175258 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.175388 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.175564 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.175701 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.175867 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.175997 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.176175 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.176310 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.176473 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.176610 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.176805 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.176930 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.177081 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.177233 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.177373 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.177544 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.177675 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.177847 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.177978 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.178155 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.178287 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.178463 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.178595 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.178773 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.178905 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.179086 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.179229 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.179388 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.179519 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.179713 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.179849 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.180019 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.180159 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.180319 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.180456 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.180696 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.180828 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.181000 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.181132 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.181299 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.181429 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.181605 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.181744 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.181954 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.182085 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.182210 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.182336 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.182495 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.182625 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.182793 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.182923 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.183108 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.183239 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.183406 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.183536 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.184271 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.184444 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.184786 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.185009 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.185162 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.185302 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.185431 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.185557 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.185690 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.185826 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.185955 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.186090 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.186263 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.186394 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.186566 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.186698 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.186866 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.186998 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.187164 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.187304 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.187480 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.187619 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.187779 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.187922 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.188094 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.188238 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.188457 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.188578 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.188801 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.188935 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.189109 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.189239 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.189420 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.189559 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.189721 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.189852 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.190037 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.190176 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.190354 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.190486 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.190666 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.190805 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.190982 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.191113 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.191286 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.191424 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.191598 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.191728 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.191904 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.192034 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.192221 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.192364 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.192538 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.192718 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.192848 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.192973 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.193161 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.193307 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.193462 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.193614 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.193778 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.193916 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.194076 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.194230 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.194403 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.194550 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.194719 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.194860 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.194989 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.195116 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.195266 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.195410 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.195576 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.195709 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.195885 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.196060 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.196198 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.196326 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.196474 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.196604 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.196798 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.196942 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.197116 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.197247 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.197429 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.197559 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.197746 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.197885 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.198064 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.198203 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.198364 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.198487 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.198676 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.198804 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.198978 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.199121 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.199279 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.199453 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.200107 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.200329 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.200559 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.200818 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.200952 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.201080 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.201206 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.201348 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.201477 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.201604 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.201729 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.201856 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.201983 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.202122 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.202273 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.202405 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.202603 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.202742 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.202925 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.203066 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.203236 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.203367 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.203521 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.203649 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.203822 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.203954 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.204124 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.204255 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.204426 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.204555 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.204754 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.204888 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.205055 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.205187 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.205360 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.205513 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.205665 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.205825 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.205988 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.206116 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.206251 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.206379 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.206515 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.206669 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.206807 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.206981 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.207111 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.207294 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.207438 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.207614 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.207752 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.207914 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.208044 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.208214 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.208353 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.208519 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.208672 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.208856 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.208987 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.209157 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.209296 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.209456 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.209596 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.209761 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.209899 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.210042 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.210169 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.210345 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.210484 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.210643 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.210782 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.210959 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.211110 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.211259 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.211399 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.211573 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.211713 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.211878 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.212009 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.212177 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.212315 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.212461 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.212600 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.212773 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.212911 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.213101 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.213231 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.213397 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.213541 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.213699 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.213873 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.214000 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.214126 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.214305 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.214447 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.214617 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.214755 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.214932 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.215255 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.215462 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.215686 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.215944 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.216082 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.216209 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.216325 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.216464 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.216592 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.216746 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.216887 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.217063 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.217193 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.217328 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.217456 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.217582 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.217716 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.217852 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.217987 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.218114 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.218240 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.218365 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.218552 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.218676 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.218930 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.219099 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.219243 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.219420 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.219559 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.219727 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.219868 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.220034 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.220164 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.220397 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.220724 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.220873 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.221003 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.221129 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.221255 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.221386 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.221512 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.221685 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.221822 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.221951 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.222078 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.222212 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.222339 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.222475 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.222602 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.222750 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.222889 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.223070 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.223210 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.223400 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.223538 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.223710 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.223841 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.224107 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.224263 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.224415 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.224542 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.224695 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.224910 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.225041 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.225182 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.225318 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.225444 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.225577 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.225704 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.225864 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.226003 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.226175 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.226304 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.226481 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.226612 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.226786 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.226923 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.227090 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.227301 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.227431 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.227615 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.227754 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.227944 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.228075 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.228266 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.228396 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.228607 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.228799 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.228939 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.229074 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.229201 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.229328 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.229570 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.229718 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.229846 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.229972 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.230098 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.230225 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.230389 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.230528 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.230789 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.230995 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.231222 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.231433 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.231568 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.231696 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.231822 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.231949 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.232076 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.232268 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.232401 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.232572 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.232788 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.232929 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.233120 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.233260 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.233464 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.233588 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.233775 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.233934 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.234098 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.234240 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.234399 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.234532 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.234707 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.234839 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.235007 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.235147 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.235329 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.235460 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.235630 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.235768 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.235925 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.236057 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.236228 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.236366 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.236531 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.236714 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.236862 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.237077 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.237208 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.237420 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.237557 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.237724 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.237854 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.238025 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.238156 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.238331 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.238463 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.238629 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.238753 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.238926 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.239056 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.239233 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.239363 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.239532 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.239664 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.239830 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.239961 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.240136 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.240267 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.240438 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.240570 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.240759 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.240892 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.241061 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.241201 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.241359 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.241489 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.241663 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.241794 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.241961 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.242100 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.242265 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.242403 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.242562 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.242692 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.242866 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.243007 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.243163 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.243293 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.243459 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.243588 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.243755 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.243886 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.244061 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.244189 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.244359 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.244495 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.244686 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.244819 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.244982 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.245112 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.245281 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.245411 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.245590 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.245740 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.245897 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.246027 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.246709 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.246865 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.247077 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.247290 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.247507 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.247669 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.247798 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.247997 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.248139 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.248298 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.248437 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.248618 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.248769 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.248948 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.249102 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.249234 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.249442 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.249573 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.249749 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.249889 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.250052 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.250189 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.250355 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.250494 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.250672 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.250812 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.250980 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.251110 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.251287 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.251418 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.251593 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.251859 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.251991 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.252193 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.252325 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.252499 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.252643 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.252834 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.252961 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.253122 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.253264 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.253426 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.253566 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.253760 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.253891 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.254076 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.254208 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.254390 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.254531 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.254694 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.254824 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.255002 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.255133 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.255305 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.255444 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.255606 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.255735 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.255912 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.256043 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.256215 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.256352 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.256516 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.256645 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.256845 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.256977 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.257150 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.257282 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.257447 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.257585 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.257785 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.257914 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.258098 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.258229 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.258409 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.258539 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.258721 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.258859 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.259026 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.259149 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.259332 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.259463 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.259635 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.259776 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.259940 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.260071 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.260252 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.260382 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.260561 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.260749 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.260887 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.261014 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.261182 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.261320 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.261544 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.261674 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.262474 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.262687 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.262892 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.263103 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.263278 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.263408 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.263536 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.263662 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.263796 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.263913 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.264047 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.264183 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.264319 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.264447 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.264612 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.264782 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.265016 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.265153 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.265342 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.265480 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.265655 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.265794 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.265972 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.266103 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.266291 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.266429 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.266590 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.266728 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.266892 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.267009 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.267192 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.267322 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.267573 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.267833 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.267833 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.268042 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.268168 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.268295 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.268431 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.268558 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.268721 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.268863 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.268991 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.269119 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.269302 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.269432 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.269631 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.269819 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.269953 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.270086 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.270222 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.270351 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.270531 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.270660 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.270842 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.270984 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.271150 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.271285 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.271455 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.271585 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.271758 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.271896 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.272063 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.272194 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.272368 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.272500 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.272685 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.272832 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.272996 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.273126 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.273308 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.273439 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.273607 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.273737 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.273928 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.274063 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.274248 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.274380 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.274566 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.274697 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.274878 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.275007 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.275187 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.275317 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.275511 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.275642 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.275819 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.275950 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.276136 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.276266 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.276402 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108062) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 09:39:16.276537 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.276756 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.277121 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.277386 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.278221 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.278548 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.279046 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.279476 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.279830 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.280146 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.280758 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.281084 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:16.281327 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108063) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 09:39:16.300717 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG oslo_db.sqlalchemy.engines [None req-9831c0bf-3eef-403a-b86d-d15bbad7d63e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108062) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:39:16.304162 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG oslo_db.sqlalchemy.engines [None req-9342121f-133d-4f6e-be24-6f3384a7176c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108063) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:39:16.479178 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.context [None req-9831c0bf-3eef-403a-b86d-d15bbad7d63e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),356e6bf2-a214-4629-b73a-1cdeb48ef84c(cell1) {{(pid=108062) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 09:39:16.479396 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.context [None req-9342121f-133d-4f6e-be24-6f3384a7176c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),356e6bf2-a214-4629-b73a-1cdeb48ef84c(cell1) {{(pid=108063) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 09:39:16.484222 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG oslo_concurrency.lockutils [None req-9831c0bf-3eef-403a-b86d-d15bbad7d63e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:39:16.484345 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG oslo_concurrency.lockutils [None req-9342121f-133d-4f6e-be24-6f3384a7176c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:39:16.485857 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG oslo_concurrency.lockutils [None req-9342121f-133d-4f6e-be24-6f3384a7176c None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:39:16.486035 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG oslo_concurrency.lockutils [None req-9831c0bf-3eef-403a-b86d-d15bbad7d63e None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:39:16.486691 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG oslo_concurrency.lockutils [None req-9342121f-133d-4f6e-be24-6f3384a7176c None None] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:39:16.486861 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG oslo_concurrency.lockutils [None req-9831c0bf-3eef-403a-b86d-d15bbad7d63e None None] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:39:16.488609 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG oslo_concurrency.lockutils [None req-9342121f-133d-4f6e-be24-6f3384a7176c None None] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:39:16.488782 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG oslo_concurrency.lockutils [None req-9831c0bf-3eef-403a-b86d-d15bbad7d63e None None] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108062) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:39:16.499886 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG oslo_db.sqlalchemy.engines [None req-9831c0bf-3eef-403a-b86d-d15bbad7d63e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108062) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:39:16.502510 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG oslo_db.sqlalchemy.engines [None req-9831c0bf-3eef-403a-b86d-d15bbad7d63e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108062) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:39:16.505034 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG oslo_db.sqlalchemy.engines [None req-9342121f-133d-4f6e-be24-6f3384a7176c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108063) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:39:16.507381 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG oslo_db.sqlalchemy.engines [None req-9342121f-133d-4f6e-be24-6f3384a7176c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108063) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:39:16.767896 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG oslo_db.sqlalchemy.engines [None req-9831c0bf-3eef-403a-b86d-d15bbad7d63e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108062) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:39:16.771661 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG oslo_db.sqlalchemy.engines [None req-9342121f-133d-4f6e-be24-6f3384a7176c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108063) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:39:17.216747 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: WARNING keystonemiddleware.auth_token [None req-9831c0bf-3eef-403a-b86d-d15bbad7d63e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 09:39:17.223360 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: WARNING keystonemiddleware.auth_token [None req-9831c0bf-3eef-403a-b86d-d15bbad7d63e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 09:39:17.302808 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: WARNING keystonemiddleware.auth_token [None req-9342121f-133d-4f6e-be24-6f3384a7176c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 09:39:17.309402 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: WARNING keystonemiddleware.auth_token [None req-9342121f-133d-4f6e-be24-6f3384a7176c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 09:39:17.595305 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: WARNING keystonemiddleware.auth_token [None req-9831c0bf-3eef-403a-b86d-d15bbad7d63e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 09:39:17.600751 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: WARNING keystonemiddleware.auth_token [None req-9831c0bf-3eef-403a-b86d-d15bbad7d63e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 09:39:17.607334 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5638f1f259c0 pid: 108062 (default app) Oct 28 09:39:17.609497 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-9831c0bf-3eef-403a-b86d-d15bbad7d63e None None] Calling method '>' {{(pid=108062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:39:17.610685 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.requestlog [None req-9831c0bf-3eef-403a-b86d-d15bbad7d63e None None] 10.222.0.104 "GET /compute/v2.1/" status: 200 len: 389 microversion: 2.1 time: 0.001800 Oct 28 09:39:17.611092 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: [pid: 108062|app: 0|req: 1/1] 10.222.0.104 () {50 vars in 793 bytes} [Thu Oct 28 09:39:17 2021] GET /compute/v2.1/ => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:39:17.663107 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: WARNING keystonemiddleware.auth_token [None req-9342121f-133d-4f6e-be24-6f3384a7176c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 09:39:17.669304 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: WARNING keystonemiddleware.auth_token [None req-9342121f-133d-4f6e-be24-6f3384a7176c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 09:39:17.675803 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5638f1f259c0 pid: 108063 (default app) Oct 28 09:40:49.549030 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-9831c0bf-3eef-403a-b86d-d15bbad7d63e None None] Calling method '>' {{(pid=108062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:40:49.550720 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.requestlog [None req-9831c0bf-3eef-403a-b86d-d15bbad7d63e None None] 10.222.0.104 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002156 Oct 28 09:40:49.557124 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: [pid: 108062|app: 0|req: 2/2] 10.222.0.104 () {54 vars in 935 bytes} [Thu Oct 28 09:40:49 2021] GET /compute/v2.1 => generated 389 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:40:50.141265 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-68a29648-6915-4654-b1ec-5ef9083ab035 admin admin] Calling method '>' {{(pid=108063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:40:50.199588 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.requestlog [None req-68a29648-6915-4654-b1ec-5ef9083ab035 admin admin] 10.222.0.104 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.638515 Oct 28 09:40:50.200583 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: [pid: 108063|app: 0|req: 1/3] 10.222.0.104 () {60 vars in 1296 bytes} [Thu Oct 28 09:40:49 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:40:53.051738 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-9831c0bf-3eef-403a-b86d-d15bbad7d63e None None] Calling method '>' {{(pid=108062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:40:53.052627 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.requestlog [None req-9831c0bf-3eef-403a-b86d-d15bbad7d63e None None] 10.222.0.104 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001484 Oct 28 09:40:53.054675 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: [pid: 108062|app: 0|req: 3/4] 10.222.0.104 () {54 vars in 935 bytes} [Thu Oct 28 09:40:53 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:40:53.146620 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-c038bed0-d9f2-44fa-9afe-67d070ccd427 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 256, "id": "c1", "disk": 1}} {{(pid=108063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:40:53.184695 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:40:53.184695 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: warnings.warn(msg) Oct 28 09:40:53.299873 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.requestlog [None req-c038bed0-d9f2-44fa-9afe-67d070ccd427 admin admin] 10.222.0.104 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.61 time: 0.236301 Oct 28 09:40:53.300701 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: [pid: 108063|app: 0|req: 2/5] 10.222.0.104 () {64 vars in 1287 bytes} [Thu Oct 28 09:40:53 2021] POST /compute/v2.1/flavors => generated 409 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:40:53.575139 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-01acf319-c942-412e-a2ea-8c453b254a84 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:40:53.577758 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:40:53.577758 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: warnings.warn(msg) Oct 28 09:40:53.715342 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.requestlog [None req-01acf319-c942-412e-a2ea-8c453b254a84 admin admin] 10.222.0.104 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.405210 Oct 28 09:40:53.716358 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: [pid: 108062|app: 0|req: 4/6] 10.222.0.104 () {64 vars in 1340 bytes} [Thu Oct 28 09:40:53 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:40:56.241949 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-c038bed0-d9f2-44fa-9afe-67d070ccd427 admin admin] Calling method '>' {{(pid=108063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:40:56.242863 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.requestlog [None req-c038bed0-d9f2-44fa-9afe-67d070ccd427 admin admin] 10.222.0.104 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001728 Oct 28 09:40:56.243810 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: [pid: 108063|app: 0|req: 3/7] 10.222.0.104 () {54 vars in 935 bytes} [Thu Oct 28 09:40:56 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:40:56.425009 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-9f55cef6-eef8-4799-93c2-cb337574feef admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 5, "name": "ds512M", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512}} {{(pid=108062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:40:56.454490 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:40:56.454490 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: warnings.warn(msg) Oct 28 09:40:56.712594 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.requestlog [None req-9f55cef6-eef8-4799-93c2-cb337574feef admin admin] 10.222.0.104 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.459831 Oct 28 09:40:56.713547 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: [pid: 108062|app: 0|req: 5/8] 10.222.0.104 () {64 vars in 1287 bytes} [Thu Oct 28 09:40:56 2021] POST /compute/v2.1/flavors => generated 406 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:40:56.727240 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-227fe768-f730-40d9-b6d3-9affe9b5175c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:40:56.728819 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:40:56.728819 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: warnings.warn(msg) Oct 28 09:40:56.863112 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.requestlog [None req-227fe768-f730-40d9-b6d3-9affe9b5175c admin admin] 10.222.0.104 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.139673 Oct 28 09:40:56.864265 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: [pid: 108063|app: 0|req: 4/9] 10.222.0.104 () {64 vars in 1340 bytes} [Thu Oct 28 09:40:56 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:40:59.363329 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-9f55cef6-eef8-4799-93c2-cb337574feef admin admin] Calling method '>' {{(pid=108062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:40:59.364376 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.requestlog [None req-9f55cef6-eef8-4799-93c2-cb337574feef admin admin] 10.222.0.104 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002069 Oct 28 09:40:59.365220 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: [pid: 108062|app: 0|req: 6/10] 10.222.0.104 () {54 vars in 935 bytes} [Thu Oct 28 09:40:59 2021] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:40:59.434046 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-a6777b8a-7791-4772-ba09-8ae5c25ef519 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "swap": 0, "vcpus": 1, "disk": 10, "id": "d2", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 1024}} {{(pid=108063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:40:59.567683 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.requestlog [None req-a6777b8a-7791-4772-ba09-8ae5c25ef519 admin admin] 10.222.0.104 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.195123 Oct 28 09:40:59.572707 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: [pid: 108063|app: 0|req: 5/11] 10.222.0.104 () {64 vars in 1287 bytes} [Thu Oct 28 09:40:59 2021] POST /compute/v2.1/flavors => generated 406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 09:40:59.590873 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-4b211959-07cc-4e03-a5e2-5ba72af6d957 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:40:59.827263 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.requestlog [None req-4b211959-07cc-4e03-a5e2-5ba72af6d957 admin admin] 10.222.0.104 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.242372 Oct 28 09:40:59.827874 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: [pid: 108062|app: 0|req: 7/12] 10.222.0.104 () {64 vars in 1340 bytes} [Thu Oct 28 09:40:59 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:41:02.311570 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-a6777b8a-7791-4772-ba09-8ae5c25ef519 admin admin] Calling method '>' {{(pid=108063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:41:02.312582 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.requestlog [None req-a6777b8a-7791-4772-ba09-8ae5c25ef519 admin admin] 10.222.0.104 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001451 Oct 28 09:41:02.313016 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: [pid: 108063|app: 0|req: 6/13] 10.222.0.104 () {54 vars in 935 bytes} [Thu Oct 28 09:41:02 2021] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:41:02.401133 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-9e797fe0-54d1-4339-a7b4-de6d360a5c1c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "id": "d3", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0, "name": "ds2G", "ram": 2048}} {{(pid=108062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:41:02.517836 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.requestlog [None req-9e797fe0-54d1-4339-a7b4-de6d360a5c1c admin admin] 10.222.0.104 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.196996 Oct 28 09:41:02.518768 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: [pid: 108062|app: 0|req: 8/14] 10.222.0.104 () {64 vars in 1287 bytes} [Thu Oct 28 09:41:02 2021] POST /compute/v2.1/flavors => generated 406 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:41:02.533550 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-7576741f-fa45-46b4-ad31-8f443cba100d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:41:02.636524 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.requestlog [None req-7576741f-fa45-46b4-ad31-8f443cba100d admin admin] 10.222.0.104 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.106818 Oct 28 09:41:02.637090 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: [pid: 108063|app: 0|req: 7/15] 10.222.0.104 () {64 vars in 1340 bytes} [Thu Oct 28 09:41:02 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:41:05.166964 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-9e797fe0-54d1-4339-a7b4-de6d360a5c1c admin admin] Calling method '>' {{(pid=108062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:41:05.167971 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.requestlog [None req-9e797fe0-54d1-4339-a7b4-de6d360a5c1c admin admin] 10.222.0.104 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001457 Oct 28 09:41:05.168370 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: [pid: 108062|app: 0|req: 9/16] 10.222.0.104 () {54 vars in 935 bytes} [Thu Oct 28 09:41:05 2021] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:41:05.249732 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-21954f41-5039-4dd9-b9d9-c1bbb010c8b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 4096, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4, "id": "d4", "os-flavor-access:is_public": true, "name": "ds4G"}} {{(pid=108063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:41:05.341343 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.requestlog [None req-21954f41-5039-4dd9-b9d9-c1bbb010c8b4 admin admin] 10.222.0.104 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.165381 Oct 28 09:41:05.343203 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: [pid: 108063|app: 0|req: 8/17] 10.222.0.104 () {64 vars in 1287 bytes} [Thu Oct 28 09:41:05 2021] POST /compute/v2.1/flavors => generated 406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:41:05.356188 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-cb3b60fe-ad36-4a34-b8af-92f684dda02d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:41:05.475536 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.requestlog [None req-cb3b60fe-ad36-4a34-b8af-92f684dda02d admin admin] 10.222.0.104 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.122193 Oct 28 09:41:05.476354 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: [pid: 108062|app: 0|req: 10/18] 10.222.0.104 () {64 vars in 1340 bytes} [Thu Oct 28 09:41:05 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:41:08.330135 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-21954f41-5039-4dd9-b9d9-c1bbb010c8b4 admin admin] Calling method '>' {{(pid=108063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:41:08.331165 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.requestlog [None req-21954f41-5039-4dd9-b9d9-c1bbb010c8b4 admin admin] 10.222.0.104 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001505 Oct 28 09:41:08.331578 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: [pid: 108063|app: 0|req: 9/19] 10.222.0.104 () {54 vars in 935 bytes} [Thu Oct 28 09:41:08 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:41:08.406742 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-7e1ff87b-6c13-439d-b60e-236a40f54df0 admin admin] Calling method '>' {{(pid=108062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:41:08.438961 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.requestlog [None req-7e1ff87b-6c13-439d-b60e-236a40f54df0 admin admin] 10.222.0.104 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2116 microversion: 2.61 time: 0.099177 Oct 28 09:41:08.439512 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: [pid: 108062|app: 0|req: 11/20] 10.222.0.104 () {60 vars in 1296 bytes} [Thu Oct 28 09:41:08 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2116 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:41:10.958270 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-21954f41-5039-4dd9-b9d9-c1bbb010c8b4 admin admin] Calling method '>' {{(pid=108063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:41:10.959420 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.requestlog [None req-21954f41-5039-4dd9-b9d9-c1bbb010c8b4 admin admin] 10.222.0.104 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001487 Oct 28 09:41:10.960137 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: [pid: 108063|app: 0|req: 10/21] 10.222.0.104 () {54 vars in 935 bytes} [Thu Oct 28 09:41:10 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:41:11.026601 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-5eefb0ca-700a-4c56-832f-ffdd490fd299 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "id": "1", "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "name": "m1.tiny"}} {{(pid=108062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:41:11.129714 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.requestlog [None req-5eefb0ca-700a-4c56-832f-ffdd490fd299 admin admin] 10.222.0.104 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.162274 Oct 28 09:41:11.130348 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: [pid: 108062|app: 0|req: 12/22] 10.222.0.104 () {64 vars in 1287 bytes} [Thu Oct 28 09:41:10 2021] POST /compute/v2.1/flavors => generated 404 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:41:11.144452 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-96e8a8a3-9c69-464a-8a9a-86df3447e981 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:41:11.288420 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.requestlog [None req-96e8a8a3-9c69-464a-8a9a-86df3447e981 admin admin] 10.222.0.104 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.147071 Oct 28 09:41:11.289640 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: [pid: 108063|app: 0|req: 11/23] 10.222.0.104 () {64 vars in 1337 bytes} [Thu Oct 28 09:41:11 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:41:13.749884 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-5eefb0ca-700a-4c56-832f-ffdd490fd299 admin admin] Calling method '>' {{(pid=108062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:41:13.751505 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.requestlog [None req-5eefb0ca-700a-4c56-832f-ffdd490fd299 admin admin] 10.222.0.104 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001966 Oct 28 09:41:13.752174 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: [pid: 108062|app: 0|req: 13/24] 10.222.0.104 () {54 vars in 935 bytes} [Thu Oct 28 09:41:13 2021] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:41:13.822368 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-a763eb80-4c1b-4953-b140-653b6d12dca2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.small", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "2", "vcpus": 1, "rxtx_factor": 1.0, "swap": 0}} {{(pid=108063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:41:13.962212 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.requestlog [None req-a763eb80-4c1b-4953-b140-653b6d12dca2 admin admin] 10.222.0.104 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.199711 Oct 28 09:41:13.962774 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: [pid: 108063|app: 0|req: 12/25] 10.222.0.104 () {64 vars in 1287 bytes} [Thu Oct 28 09:41:13 2021] POST /compute/v2.1/flavors => generated 407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:41:13.975971 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-a49c2818-918a-49c9-982a-be94a27ceb89 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:41:14.121117 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.requestlog [None req-a49c2818-918a-49c9-982a-be94a27ceb89 admin admin] 10.222.0.104 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.149288 Oct 28 09:41:14.121701 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: [pid: 108062|app: 0|req: 14/26] 10.222.0.104 () {64 vars in 1337 bytes} [Thu Oct 28 09:41:13 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:41:16.492489 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-a763eb80-4c1b-4953-b140-653b6d12dca2 admin admin] Calling method '>' {{(pid=108063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:41:16.493527 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.requestlog [None req-a763eb80-4c1b-4953-b140-653b6d12dca2 admin admin] 10.222.0.104 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001476 Oct 28 09:41:16.494149 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: [pid: 108063|app: 0|req: 13/27] 10.222.0.104 () {54 vars in 935 bytes} [Thu Oct 28 09:41:16 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:41:16.575167 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-d2679d98-d750-4d47-829f-7317255e8e59 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "rxtx_factor": 1.0, "name": "m1.medium", "ram": 4096, "swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "3"}} {{(pid=108062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:41:16.711451 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.requestlog [None req-d2679d98-d750-4d47-829f-7317255e8e59 admin admin] 10.222.0.104 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.209311 Oct 28 09:41:16.712027 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: [pid: 108062|app: 0|req: 15/28] 10.222.0.104 () {64 vars in 1287 bytes} [Thu Oct 28 09:41:16 2021] POST /compute/v2.1/flavors => generated 408 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:41:16.726152 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-f3c16269-a690-454f-afa8-5c43b05f62e7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:41:16.826359 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.requestlog [None req-f3c16269-a690-454f-afa8-5c43b05f62e7 admin admin] 10.222.0.104 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104938 Oct 28 09:41:16.826969 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: [pid: 108063|app: 0|req: 14/29] 10.222.0.104 () {64 vars in 1337 bytes} [Thu Oct 28 09:41:16 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:41:19.388779 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-d2679d98-d750-4d47-829f-7317255e8e59 admin admin] Calling method '>' {{(pid=108062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:41:19.390501 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.requestlog [None req-d2679d98-d750-4d47-829f-7317255e8e59 admin admin] 10.222.0.104 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002215 Oct 28 09:41:19.391190 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: [pid: 108062|app: 0|req: 16/30] 10.222.0.104 () {54 vars in 935 bytes} [Thu Oct 28 09:41:19 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:41:19.467663 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-4d92df49-b49d-4317-b5bf-ccb06fd17d76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "rxtx_factor": 1.0, "id": "4", "vcpus": 4, "os-flavor-access:is_public": true, "name": "m1.large", "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=108063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:41:19.618961 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.requestlog [None req-4d92df49-b49d-4317-b5bf-ccb06fd17d76 admin admin] 10.222.0.104 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.220296 Oct 28 09:41:19.619562 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: [pid: 108063|app: 0|req: 15/31] 10.222.0.104 () {64 vars in 1287 bytes} [Thu Oct 28 09:41:19 2021] POST /compute/v2.1/flavors => generated 407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 09:41:19.633344 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-eff56851-03e4-4075-83e9-bd35bf3aae11 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:41:19.725901 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.requestlog [None req-eff56851-03e4-4075-83e9-bd35bf3aae11 admin admin] 10.222.0.104 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097218 Oct 28 09:41:19.726872 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: [pid: 108062|app: 0|req: 17/32] 10.222.0.104 () {64 vars in 1337 bytes} [Thu Oct 28 09:41:19 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:41:22.202490 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-4d92df49-b49d-4317-b5bf-ccb06fd17d76 admin admin] Calling method '>' {{(pid=108063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:41:22.208791 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.requestlog [None req-4d92df49-b49d-4317-b5bf-ccb06fd17d76 admin admin] 10.222.0.104 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.006979 Oct 28 09:41:22.209224 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: [pid: 108063|app: 0|req: 16/33] 10.222.0.104 () {54 vars in 935 bytes} [Thu Oct 28 09:41:22 2021] GET /compute/v2.1 => generated 389 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:41:22.282394 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-25a2924d-5270-43a8-85ee-54fb403eeb6d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 16384, "id": "5", "name": "m1.xlarge", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "vcpus": 8, "swap": 0}} {{(pid=108062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:41:22.388266 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.requestlog [None req-25a2924d-5270-43a8-85ee-54fb403eeb6d admin admin] 10.222.0.104 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.61 time: 0.170342 Oct 28 09:41:22.389215 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: [pid: 108062|app: 0|req: 18/34] 10.222.0.104 () {64 vars in 1287 bytes} [Thu Oct 28 09:41:22 2021] POST /compute/v2.1/flavors => generated 410 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:41:22.404377 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-81300db7-4af0-4690-9b99-f7e431bc14fe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=108063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:41:22.493929 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.requestlog [None req-81300db7-4af0-4690-9b99-f7e431bc14fe admin admin] 10.222.0.104 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094599 Oct 28 09:41:22.494485 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: [pid: 108063|app: 0|req: 17/35] 10.222.0.104 () {64 vars in 1337 bytes} [Thu Oct 28 09:41:22 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:42:04.626400 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-25a2924d-5270-43a8-85ee-54fb403eeb6d admin admin] Calling method '>' {{(pid=108062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:04.627439 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.requestlog [None req-25a2924d-5270-43a8-85ee-54fb403eeb6d admin admin] 10.222.0.104 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001562 Oct 28 09:42:04.627943 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: [pid: 108062|app: 0|req: 19/36] 10.222.0.104 () {54 vars in 935 bytes} [Thu Oct 28 09:42:04 2021] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:42:04.691155 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-a215b395-0c05-4fd8-8ef4-fe7503b45462 admin admin] Calling method '>' {{(pid=108063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:04.709797 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.requestlog [None req-a215b395-0c05-4fd8-8ef4-fe7503b45462 admin admin] 10.222.0.104 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4222 microversion: 2.61 time: 0.073951 Oct 28 09:42:04.710520 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: [pid: 108063|app: 0|req: 18/37] 10.222.0.104 () {60 vars in 1296 bytes} [Thu Oct 28 09:42:04 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4222 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:42:06.298955 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-25a2924d-5270-43a8-85ee-54fb403eeb6d admin admin] Calling method '>' {{(pid=108062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:06.300717 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.requestlog [None req-25a2924d-5270-43a8-85ee-54fb403eeb6d admin admin] 10.222.0.104 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001409 Oct 28 09:42:06.302224 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: [pid: 108062|app: 0|req: 20/38] 10.222.0.104 () {56 vars in 1079 bytes} [Thu Oct 28 09:42:06 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:42:06.500157 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-78e8e1fc-3155-4040-9237-7b245861299a admin admin] Calling method '>' {{(pid=108063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:06.505732 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.wsgi [None req-78e8e1fc-3155-4040-9237-7b245861299a admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 28 09:42:06.506296 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-78e8e1fc-3155-4040-9237-7b245861299a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:42:06.507087 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.requestlog [None req-78e8e1fc-3155-4040-9237-7b245861299a admin admin] 10.222.0.104 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062825 Oct 28 09:42:06.507588 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: [pid: 108063|app: 0|req: 19/39] 10.222.0.104 () {60 vars in 1195 bytes} [Thu Oct 28 09:42:06 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 09:42:06.517407 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-b993b822-5882-42f0-92bb-46b9003f5eee admin admin] Calling method '>' {{(pid=108062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:06.540710 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.requestlog [None req-b993b822-5882-42f0-92bb-46b9003f5eee admin admin] 10.222.0.104 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.026662 Oct 28 09:42:06.541196 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: [pid: 108062|app: 0|req: 21/40] 10.222.0.104 () {60 vars in 1215 bytes} [Thu Oct 28 09:42:06 2021] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:42:06.554027 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-1bb5e1f4-cc9c-41ea-949a-1445b08e25ae admin admin] Calling method '>' {{(pid=108063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:06.578687 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.requestlog [None req-1bb5e1f4-cc9c-41ea-949a-1445b08e25ae admin admin] 10.222.0.104 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.030372 Oct 28 09:42:06.579274 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: [pid: 108063|app: 0|req: 20/41] 10.222.0.104 () {60 vars in 1215 bytes} [Thu Oct 28 09:42:06 2021] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:42:06.589633 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-bf6a73e9-835f-489b-9d9e-0f38c5380e6b admin admin] Calling method '>' {{(pid=108062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:06.595186 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.wsgi [None req-bf6a73e9-835f-489b-9d9e-0f38c5380e6b admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 28 09:42:06.595754 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-bf6a73e9-835f-489b-9d9e-0f38c5380e6b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=108062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:42:06.597311 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.requestlog [None req-bf6a73e9-835f-489b-9d9e-0f38c5380e6b admin admin] 10.222.0.104 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010565 Oct 28 09:42:06.597923 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: [pid: 108062|app: 0|req: 22/42] 10.222.0.104 () {60 vars in 1195 bytes} [Thu Oct 28 09:42:06 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 09:42:08.051044 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-1bb5e1f4-cc9c-41ea-949a-1445b08e25ae admin admin] Calling method '>' {{(pid=108063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:08.052039 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.requestlog [None req-1bb5e1f4-cc9c-41ea-949a-1445b08e25ae admin admin] 10.222.0.104 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001578 Oct 28 09:42:08.052436 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: [pid: 108063|app: 0|req: 21/43] 10.222.0.104 () {56 vars in 1079 bytes} [Thu Oct 28 09:42:08 2021] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:42:08.246869 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-a60c5831-4e7b-4fde-849a-bc9c1e34ebef admin admin] Calling method '>' {{(pid=108062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:08.253181 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.wsgi [None req-a60c5831-4e7b-4fde-849a-bc9c1e34ebef admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 28 09:42:08.253728 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-a60c5831-4e7b-4fde-849a-bc9c1e34ebef admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:42:08.254524 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.requestlog [None req-a60c5831-4e7b-4fde-849a-bc9c1e34ebef admin admin] 10.222.0.104 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.062744 Oct 28 09:42:08.255054 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: [pid: 108062|app: 0|req: 23/44] 10.222.0.104 () {60 vars in 1195 bytes} [Thu Oct 28 09:42:08 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 09:42:08.264908 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-7a0dfabc-a185-4af8-aed2-f84c10ec905c admin admin] Calling method '>' {{(pid=108063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:08.279458 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.requestlog [None req-7a0dfabc-a185-4af8-aed2-f84c10ec905c admin admin] 10.222.0.104 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.018022 Oct 28 09:42:08.280010 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: [pid: 108063|app: 0|req: 22/45] 10.222.0.104 () {60 vars in 1215 bytes} [Thu Oct 28 09:42:08 2021] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:42:08.290462 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-8112ce92-ca07-49ce-acbb-28a36f6f96c0 admin admin] Calling method '>' {{(pid=108062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:08.305285 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.requestlog [None req-8112ce92-ca07-49ce-acbb-28a36f6f96c0 admin admin] 10.222.0.104 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.018454 Oct 28 09:42:08.305836 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: [pid: 108062|app: 0|req: 24/46] 10.222.0.104 () {60 vars in 1215 bytes} [Thu Oct 28 09:42:08 2021] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:42:08.316836 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-b97f8e54-9fbe-4908-a365-4663df5e3827 admin admin] Calling method '>' {{(pid=108063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:08.322452 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.wsgi [None req-b97f8e54-9fbe-4908-a365-4663df5e3827 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 28 09:42:08.323021 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-b97f8e54-9fbe-4908-a365-4663df5e3827 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=108063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:42:08.323823 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.requestlog [None req-b97f8e54-9fbe-4908-a365-4663df5e3827 admin admin] 10.222.0.104 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011605 Oct 28 09:42:08.324342 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: [pid: 108063|app: 0|req: 23/47] 10.222.0.104 () {60 vars in 1195 bytes} [Thu Oct 28 09:42:08 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 28 09:42:09.823894 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-8112ce92-ca07-49ce-acbb-28a36f6f96c0 admin admin] Calling method '>' {{(pid=108062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:09.824961 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.requestlog [None req-8112ce92-ca07-49ce-acbb-28a36f6f96c0 admin admin] 10.222.0.104 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001502 Oct 28 09:42:09.825360 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: [pid: 108062|app: 0|req: 25/48] 10.222.0.104 () {56 vars in 1079 bytes} [Thu Oct 28 09:42:09 2021] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:42:10.021247 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-7e7c9b6f-8be4-4642-a93d-f2768d0246d1 admin admin] Calling method '>' {{(pid=108063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:10.027258 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.wsgi [None req-7e7c9b6f-8be4-4642-a93d-f2768d0246d1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 28 09:42:10.027874 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-7e7c9b6f-8be4-4642-a93d-f2768d0246d1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108063) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:42:10.028644 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.requestlog [None req-7e7c9b6f-8be4-4642-a93d-f2768d0246d1 admin admin] 10.222.0.104 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060872 Oct 28 09:42:10.029387 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: [pid: 108063|app: 0|req: 24/49] 10.222.0.104 () {60 vars in 1198 bytes} [Thu Oct 28 09:42:09 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 09:42:10.040731 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-fff685ee-3e4b-41cf-9524-22e7e9dc3eaa admin admin] Calling method '>' {{(pid=108062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:10.054857 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.requestlog [None req-fff685ee-3e4b-41cf-9524-22e7e9dc3eaa admin admin] 10.222.0.104 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.019226 Oct 28 09:42:10.055407 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: [pid: 108062|app: 0|req: 26/50] 10.222.0.104 () {60 vars in 1215 bytes} [Thu Oct 28 09:42:10 2021] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:42:10.067208 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-301d8c68-4c70-4b86-a6c6-d2a0caaa9356 admin admin] Calling method '>' {{(pid=108063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:10.080578 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.requestlog [None req-301d8c68-4c70-4b86-a6c6-d2a0caaa9356 admin admin] 10.222.0.104 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.018307 Oct 28 09:42:10.081377 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: [pid: 108063|app: 0|req: 25/51] 10.222.0.104 () {60 vars in 1215 bytes} [Thu Oct 28 09:42:10 2021] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:42:10.091766 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-3507f5ec-8817-4c54-84c1-4b67549874bf admin admin] Calling method '>' {{(pid=108062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:10.097025 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.wsgi [None req-3507f5ec-8817-4c54-84c1-4b67549874bf admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 28 09:42:10.097589 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-3507f5ec-8817-4c54-84c1-4b67549874bf admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=108062) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:42:10.098560 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.requestlog [None req-3507f5ec-8817-4c54-84c1-4b67549874bf admin admin] 10.222.0.104 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010422 Oct 28 09:42:10.099074 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: [pid: 108062|app: 0|req: 27/52] 10.222.0.104 () {60 vars in 1198 bytes} [Thu Oct 28 09:42:10 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 09:42:11.534926 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-301d8c68-4c70-4b86-a6c6-d2a0caaa9356 admin admin] Calling method '>' {{(pid=108063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:11.535957 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.requestlog [None req-301d8c68-4c70-4b86-a6c6-d2a0caaa9356 admin admin] 10.222.0.104 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001634 Oct 28 09:42:11.536351 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: [pid: 108063|app: 0|req: 26/53] 10.222.0.104 () {56 vars in 1079 bytes} [Thu Oct 28 09:42:11 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:42:11.733374 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-1ddb8980-887b-46c7-9be1-3b3e2282230f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:42:11.822011 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.requestlog [None req-1ddb8980-887b-46c7-9be1-3b3e2282230f admin admin] 10.222.0.104 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.90 time: 0.143752 Oct 28 09:42:11.822478 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: [pid: 108062|app: 0|req: 28/54] 10.222.0.104 () {64 vars in 1240 bytes} [Thu Oct 28 09:42:11 2021] POST /compute/v2.1/flavors => generated 406 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:42:13.288536 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-301d8c68-4c70-4b86-a6c6-d2a0caaa9356 admin admin] Calling method '>' {{(pid=108063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:13.289590 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.requestlog [None req-301d8c68-4c70-4b86-a6c6-d2a0caaa9356 admin admin] 10.222.0.104 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001475 Oct 28 09:42:13.289983 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: [pid: 108063|app: 0|req: 27/55] 10.222.0.104 () {56 vars in 1079 bytes} [Thu Oct 28 09:42:13 2021] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:42:13.486924 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-65543cbd-c742-44a3-945b-6bdc7ae4c41a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:42:13.713153 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.requestlog [None req-65543cbd-c742-44a3-945b-6bdc7ae4c41a admin admin] 10.222.0.104 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.280416 Oct 28 09:42:13.713715 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: [pid: 108062|app: 0|req: 29/56] 10.222.0.104 () {64 vars in 1240 bytes} [Thu Oct 28 09:42:13 2021] POST /compute/v2.1/flavors => generated 407 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:42:15.174087 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-301d8c68-4c70-4b86-a6c6-d2a0caaa9356 admin admin] Calling method '>' {{(pid=108063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:15.175963 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.requestlog [None req-301d8c68-4c70-4b86-a6c6-d2a0caaa9356 admin admin] 10.222.0.104 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002175 Oct 28 09:42:15.176371 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: [pid: 108063|app: 0|req: 28/57] 10.222.0.104 () {56 vars in 1079 bytes} [Thu Oct 28 09:42:15 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:42:15.373844 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-d3e772f7-cb0a-4eef-b5e2-a4af01c56b4b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:42:15.479956 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.requestlog [None req-d3e772f7-cb0a-4eef-b5e2-a4af01c56b4b admin admin] 10.222.0.104 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.160795 Oct 28 09:42:15.480543 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: [pid: 108062|app: 0|req: 30/58] 10.222.0.104 () {64 vars in 1240 bytes} [Thu Oct 28 09:42:15 2021] POST /compute/v2.1/flavors => generated 409 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:42:16.957178 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-301d8c68-4c70-4b86-a6c6-d2a0caaa9356 admin admin] Calling method '>' {{(pid=108063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:16.958170 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.requestlog [None req-301d8c68-4c70-4b86-a6c6-d2a0caaa9356 admin admin] 10.222.0.104 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001436 Oct 28 09:42:16.958554 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: [pid: 108063|app: 0|req: 29/59] 10.222.0.104 () {56 vars in 1079 bytes} [Thu Oct 28 09:42:16 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:42:17.151837 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-a768a5a1-acbf-4284-a722-b7e8819453d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=108062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:42:17.249992 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.requestlog [None req-a768a5a1-acbf-4284-a722-b7e8819453d6 admin admin] 10.222.0.104 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.90 time: 0.151597 Oct 28 09:42:17.250572 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: [pid: 108062|app: 0|req: 31/60] 10.222.0.104 () {64 vars in 1240 bytes} [Thu Oct 28 09:42:17 2021] POST /compute/v2.1/flavors => generated 411 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:42:18.700823 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-301d8c68-4c70-4b86-a6c6-d2a0caaa9356 admin admin] Calling method '>' {{(pid=108063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:18.701852 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.requestlog [None req-301d8c68-4c70-4b86-a6c6-d2a0caaa9356 admin admin] 10.222.0.104 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001469 Oct 28 09:42:18.702237 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: [pid: 108063|app: 0|req: 30/61] 10.222.0.104 () {56 vars in 1079 bytes} [Thu Oct 28 09:42:18 2021] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:42:18.898507 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-f377c014-2cd6-4b1b-9750-96d903bfdc8d admin admin] Calling method '>' {{(pid=108062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:18.917573 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.requestlog [None req-f377c014-2cd6-4b1b-9750-96d903bfdc8d admin admin] 10.222.0.104 "GET /compute/v2.1/flavors/detail" status: 200 len: 5805 microversion: 2.90 time: 0.074004 Oct 28 09:42:18.918109 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: [pid: 108062|app: 0|req: 32/62] 10.222.0.104 () {60 vars in 1207 bytes} [Thu Oct 28 09:42:18 2021] GET /compute/v2.1/flavors/detail => generated 5805 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:43:07.959709 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-301d8c68-4c70-4b86-a6c6-d2a0caaa9356 admin admin] Calling method '>' {{(pid=108063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:43:07.960755 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.requestlog [None req-301d8c68-4c70-4b86-a6c6-d2a0caaa9356 admin admin] 10.222.0.104 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001453 Oct 28 09:43:07.961157 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: [pid: 108063|app: 0|req: 31/63] 10.222.0.104 () {54 vars in 935 bytes} [Thu Oct 28 09:43:07 2021] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:43:08.026154 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-a5d2c02e-dcf5-4034-b09a-279b268d0802 admin admin] Calling method '>' {{(pid=108062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:43:08.047821 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.requestlog [None req-a5d2c02e-dcf5-4034-b09a-279b268d0802 admin admin] 10.222.0.104 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5819 microversion: 2.61 time: 0.079901 Oct 28 09:43:08.048719 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: [pid: 108062|app: 0|req: 33/64] 10.222.0.104 () {60 vars in 1296 bytes} [Thu Oct 28 09:43:07 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5819 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:43:08.071590 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-9eb25865-301c-4ddb-91f9-214fc38471eb admin admin] Calling method '>' {{(pid=108063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:43:08.080067 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.requestlog [None req-9eb25865-301c-4ddb-91f9-214fc38471eb admin admin] 10.222.0.104 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012095 Oct 28 09:43:08.080619 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: [pid: 108063|app: 0|req: 32/65] 10.222.0.104 () {60 vars in 1287 bytes} [Thu Oct 28 09:43:08 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:43:08.092934 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-8781347c-2701-4026-99d3-a0a824c69afb admin admin] Calling method '>' {{(pid=108062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:43:08.101646 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.requestlog [None req-8781347c-2701-4026-99d3-a0a824c69afb admin admin] 10.222.0.104 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012230 Oct 28 09:43:08.102168 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: [pid: 108062|app: 0|req: 34/66] 10.222.0.104 () {60 vars in 1290 bytes} [Thu Oct 28 09:43:08 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:43:08.114843 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-d0dc9093-2f2e-43a0-803f-761f6d62018b admin admin] Calling method '>' {{(pid=108063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:43:08.122774 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.requestlog [None req-d0dc9093-2f2e-43a0-803f-761f6d62018b admin admin] 10.222.0.104 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011467 Oct 28 09:43:08.123327 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: [pid: 108063|app: 0|req: 33/67] 10.222.0.104 () {60 vars in 1290 bytes} [Thu Oct 28 09:43:08 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:43:08.136782 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-8feb09fd-2911-4c5b-8768-4c46660fd9fb admin admin] Calling method '>' {{(pid=108062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:43:08.145771 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.requestlog [None req-8feb09fd-2911-4c5b-8768-4c46660fd9fb admin admin] 10.222.0.104 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011800 Oct 28 09:43:08.145946 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: [pid: 108062|app: 0|req: 35/68] 10.222.0.104 () {60 vars in 1287 bytes} [Thu Oct 28 09:43:08 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:44:42.860923 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-3a47b763-d8d6-4598-891f-aaff17d31862 tempest-verify_tempest_config-864273337 tempest-verify_tempest_config-864273337-project] Calling method '>' {{(pid=108063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:44:42.862962 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.requestlog [None req-3a47b763-d8d6-4598-891f-aaff17d31862 tempest-verify_tempest_config-864273337 tempest-verify_tempest_config-864273337-project] 10.222.0.104 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.123263 Oct 28 09:44:42.863502 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: [pid: 108063|app: 0|req: 34/69] 10.222.0.104 () {58 vars in 1138 bytes} [Thu Oct 28 09:44:42 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:46:21.814660 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-8feb09fd-2911-4c5b-8768-4c46660fd9fb admin admin] Calling method '>' {{(pid=108062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:21.818749 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.requestlog [None req-8feb09fd-2911-4c5b-8768-4c46660fd9fb admin admin] 10.222.0.104 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001517 Oct 28 09:46:21.818749 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: [pid: 108062|app: 0|req: 36/70] 10.222.0.104 () {56 vars in 1079 bytes} [Thu Oct 28 09:46:21 2021] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:46:22.087569 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-9316f827-5153-40ee-bd00-8afad1ef42fb admin admin] Calling method '>' {{(pid=108063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:22.089993 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:46:22.089993 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: warnings.warn(msg) Oct 28 09:46:22.092173 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG oslo_concurrency.lockutils [None req-9316f827-5153-40ee-bd00-8afad1ef42fb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:46:22.093075 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG oslo_concurrency.lockutils [None req-9316f827-5153-40ee-bd00-8afad1ef42fb admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:46:22.093440 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG oslo_concurrency.lockutils [None req-9316f827-5153-40ee-bd00-8afad1ef42fb admin admin] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:46:22.094136 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG oslo_concurrency.lockutils [None req-9316f827-5153-40ee-bd00-8afad1ef42fb admin admin] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:46:22.131689 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.requestlog [None req-9316f827-5153-40ee-bd00-8afad1ef42fb admin admin] 10.222.0.104 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.165626 Oct 28 09:46:22.132458 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: [pid: 108063|app: 0|req: 35/71] 10.222.0.104 () {60 vars in 1198 bytes} [Thu Oct 28 09:46:21 2021] GET /compute/v2.1/os-services => generated 791 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 09:46:23.600042 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-8feb09fd-2911-4c5b-8768-4c46660fd9fb admin admin] Calling method '>' {{(pid=108062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:23.601061 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.requestlog [None req-8feb09fd-2911-4c5b-8768-4c46660fd9fb admin admin] 10.222.0.104 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001416 Oct 28 09:46:23.601454 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: [pid: 108062|app: 0|req: 37/72] 10.222.0.104 () {56 vars in 1079 bytes} [Thu Oct 28 09:46:23 2021] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:46:23.800962 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-e4098f70-ab93-4815-982b-686cb68a3f2d admin admin] Calling method '>' {{(pid=108063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:23.802069 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:46:23.802069 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: warnings.warn(msg) Oct 28 09:46:23.803649 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG oslo_concurrency.lockutils [None req-e4098f70-ab93-4815-982b-686cb68a3f2d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:46:23.804014 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG oslo_concurrency.lockutils [None req-e4098f70-ab93-4815-982b-686cb68a3f2d admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:46:23.804811 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG oslo_concurrency.lockutils [None req-e4098f70-ab93-4815-982b-686cb68a3f2d admin admin] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:46:23.805227 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG oslo_concurrency.lockutils [None req-e4098f70-ab93-4815-982b-686cb68a3f2d admin admin] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:46:23.825237 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.requestlog [None req-e4098f70-ab93-4815-982b-686cb68a3f2d admin admin] 10.222.0.104 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.082924 Oct 28 09:46:23.825796 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: [pid: 108063|app: 0|req: 36/73] 10.222.0.104 () {60 vars in 1198 bytes} [Thu Oct 28 09:46:23 2021] GET /compute/v2.1/os-services => generated 791 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:46:35.724590 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-8feb09fd-2911-4c5b-8768-4c46660fd9fb admin admin] Calling method '>' {{(pid=108062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:35.725644 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.requestlog [None req-8feb09fd-2911-4c5b-8768-4c46660fd9fb admin admin] 10.222.0.104 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001488 Oct 28 09:46:35.726042 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: [pid: 108062|app: 0|req: 38/74] 10.222.0.104 () {56 vars in 1079 bytes} [Thu Oct 28 09:46:35 2021] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:46:35.928394 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-52dad368-f88d-435a-beb2-a73279372238 admin admin] Calling method '>' {{(pid=108063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:35.929553 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:46:35.929553 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: warnings.warn(msg) Oct 28 09:46:35.931024 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG oslo_concurrency.lockutils [None req-52dad368-f88d-435a-beb2-a73279372238 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:46:35.931457 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG oslo_concurrency.lockutils [None req-52dad368-f88d-435a-beb2-a73279372238 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:46:35.932228 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG oslo_concurrency.lockutils [None req-52dad368-f88d-435a-beb2-a73279372238 admin admin] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:46:35.932766 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG oslo_concurrency.lockutils [None req-52dad368-f88d-435a-beb2-a73279372238 admin admin] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:46:35.957918 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.requestlog [None req-52dad368-f88d-435a-beb2-a73279372238 admin admin] 10.222.0.104 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083035 Oct 28 09:46:35.958477 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: [pid: 108063|app: 0|req: 37/75] 10.222.0.104 () {60 vars in 1198 bytes} [Thu Oct 28 09:46:35 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:46:37.399198 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: DEBUG nova.api.openstack.wsgi [None req-8feb09fd-2911-4c5b-8768-4c46660fd9fb admin admin] Calling method '>' {{(pid=108062) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:37.400558 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: INFO nova.api.openstack.requestlog [None req-8feb09fd-2911-4c5b-8768-4c46660fd9fb admin admin] 10.222.0.104 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001404 Oct 28 09:46:37.400972 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: [pid: 108062|app: 0|req: 39/76] 10.222.0.104 () {56 vars in 1079 bytes} [Thu Oct 28 09:46:37 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:46:37.595905 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG nova.api.openstack.wsgi [None req-b490a82b-b329-4a15-9008-2575f9b3a1a9 admin admin] Calling method '>' {{(pid=108063) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:46:37.597204 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:46:37.597204 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: warnings.warn(msg) Oct 28 09:46:37.598797 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG oslo_concurrency.lockutils [None req-b490a82b-b329-4a15-9008-2575f9b3a1a9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:46:37.599236 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG oslo_concurrency.lockutils [None req-b490a82b-b329-4a15-9008-2575f9b3a1a9 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:46:37.600044 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG oslo_concurrency.lockutils [None req-b490a82b-b329-4a15-9008-2575f9b3a1a9 admin admin] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:46:37.600463 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: DEBUG oslo_concurrency.lockutils [None req-b490a82b-b329-4a15-9008-2575f9b3a1a9 admin admin] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108063) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:46:37.621610 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: INFO nova.api.openstack.requestlog [None req-b490a82b-b329-4a15-9008-2575f9b3a1a9 admin admin] 10.222.0.104 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079033 Oct 28 09:46:37.622090 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: [pid: 108063|app: 0|req: 38/77] 10.222.0.104 () {60 vars in 1198 bytes} [Thu Oct 28 09:46:37 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:47:40.847246 dv-cinder-815712-3-iscsi devstack@n-api.service[108061]: Thu Oct 28 09:47:40 2021 - graceful shutdown triggered... Oct 28 09:47:40.852949 dv-cinder-815712-3-iscsi devstack@n-api.service[108062]: Gracefully killing worker 1 (pid: 108062)... Oct 28 09:47:40.847366 dv-cinder-815712-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 28 09:47:40.854334 dv-cinder-815712-3-iscsi devstack@n-api.service[108063]: Gracefully killing worker 2 (pid: 108063)... Oct 28 09:47:41.848889 dv-cinder-815712-3-iscsi devstack@n-api.service[108061]: worker 1 buried after 1 seconds Oct 28 09:47:41.848889 dv-cinder-815712-3-iscsi devstack@n-api.service[108061]: worker 2 buried after 1 seconds Oct 28 09:47:41.848889 dv-cinder-815712-3-iscsi devstack@n-api.service[108061]: goodbye to uWSGI. Oct 28 09:47:41.850618 dv-cinder-815712-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 28 09:47:41.851263 dv-cinder-815712-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 28 09:47:41.855468 dv-cinder-815712-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 28 09:47:41.869041 dv-cinder-815712-3-iscsi devstack@n-api.service[123049]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 28 09:47:41.871116 dv-cinder-815712-3-iscsi devstack@n-api.service[123049]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 28 09:47:41 2021] *** Oct 28 09:47:41.871308 dv-cinder-815712-3-iscsi devstack@n-api.service[123049]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 28 09:47:41.871447 dv-cinder-815712-3-iscsi devstack@n-api.service[123049]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 28 09:47:41.871571 dv-cinder-815712-3-iscsi devstack@n-api.service[123049]: nodename: dv-cinder-815712-3-iscsi Oct 28 09:47:41.871692 dv-cinder-815712-3-iscsi devstack@n-api.service[123049]: machine: x86_64 Oct 28 09:47:41.871806 dv-cinder-815712-3-iscsi devstack@n-api.service[123049]: clock source: unix Oct 28 09:47:41.872046 dv-cinder-815712-3-iscsi devstack@n-api.service[123049]: pcre jit disabled Oct 28 09:47:41.872189 dv-cinder-815712-3-iscsi devstack@n-api.service[123049]: detected number of CPU cores: 4 Oct 28 09:47:41.872303 dv-cinder-815712-3-iscsi devstack@n-api.service[123049]: current working directory: / Oct 28 09:47:41.872414 dv-cinder-815712-3-iscsi devstack@n-api.service[123049]: detected binary path: /usr/bin/uwsgi-core Oct 28 09:47:41.872561 dv-cinder-815712-3-iscsi devstack@n-api.service[123049]: your processes number limit is 47680 Oct 28 09:47:41.872561 dv-cinder-815712-3-iscsi devstack@n-api.service[123049]: your memory page size is 4096 bytes Oct 28 09:47:41.872561 dv-cinder-815712-3-iscsi devstack@n-api.service[123049]: detected max file descriptor number: 2048 Oct 28 09:47:41.872561 dv-cinder-815712-3-iscsi devstack@n-api.service[123049]: lock engine: pthread robust mutexes Oct 28 09:47:41.873202 dv-cinder-815712-3-iscsi devstack@n-api.service[123049]: thunder lock: enabled Oct 28 09:47:41.873202 dv-cinder-815712-3-iscsi devstack@n-api.service[123049]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 28 09:47:41.873202 dv-cinder-815712-3-iscsi devstack@n-api.service[123049]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 28 09:47:41.924911 dv-cinder-815712-3-iscsi devstack@n-api.service[123049]: Python main interpreter initialized at 0x55a7bc19e9c0 Oct 28 09:47:41.924911 dv-cinder-815712-3-iscsi devstack@n-api.service[123049]: python threads support enabled Oct 28 09:47:41.924911 dv-cinder-815712-3-iscsi devstack@n-api.service[123049]: your server socket listen backlog is limited to 100 connections Oct 28 09:47:41.924911 dv-cinder-815712-3-iscsi devstack@n-api.service[123049]: your mercy for graceful operations on workers is 90 seconds Oct 28 09:47:41.925383 dv-cinder-815712-3-iscsi devstack@n-api.service[123049]: mapped 403077 bytes (393 KB) for 2 cores Oct 28 09:47:41.925383 dv-cinder-815712-3-iscsi devstack@n-api.service[123049]: *** Operational MODE: preforking *** Oct 28 09:47:41.925673 dv-cinder-815712-3-iscsi devstack@n-api.service[123049]: *** uWSGI is running in multiple interpreter mode *** Oct 28 09:47:41.925673 dv-cinder-815712-3-iscsi devstack@n-api.service[123049]: spawned uWSGI master process (pid: 123049) Oct 28 09:47:41.925887 dv-cinder-815712-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 28 09:47:41.926732 dv-cinder-815712-3-iscsi devstack@n-api.service[123049]: spawned uWSGI worker 1 (pid: 123068, cores: 1) Oct 28 09:47:41.927094 dv-cinder-815712-3-iscsi devstack@n-api.service[123049]: spawned uWSGI worker 2 (pid: 123069, cores: 1) Oct 28 09:47:41.928491 dv-cinder-815712-3-iscsi devstack@n-api.service[123049]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 28 09:47:43.893026 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 09:47:43.893026 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: from cryptography.utils import int_from_bytes Oct 28 09:47:43.893677 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 09:47:43.893677 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: from cryptography.utils import int_from_bytes Oct 28 09:47:43.907839 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 09:47:43.907839 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: from cryptography.utils import int_from_bytes Oct 28 09:47:43.908425 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 09:47:43.908425 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: from cryptography.utils import int_from_bytes Oct 28 09:47:46.511953 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 09:47:46.512594 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 09:47:46.512991 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 09:47:46.513106 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 09:47:46.513321 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 09:47:46.513982 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.514316 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.514649 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.514986 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.515372 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.515699 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.516028 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.516356 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.516716 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.516986 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.517307 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.517641 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815712-3-iscsi {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.517971 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.518285 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.518603 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.518923 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.519230 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.519558 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.519861 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.520366 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.522265 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.522615 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.522950 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.523305 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.523639 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.523963 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.524294 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.524627 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.524991 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.525317 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.525741 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815712-3-iscsi {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.526073 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.526406 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.526736 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.527169 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.528838 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.528838 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.528838 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.528838 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.528838 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.529274 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.529541 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.529740 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.530094 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.530382 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.530737 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.531569 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.532019 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.532245 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.532520 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.532874 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.533044 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.533364 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.533696 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.534033 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.534287 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.534541 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.534870 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.535198 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.535518 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.535833 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.536157 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.536469 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.536815 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.537136 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.537444 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.537757 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.538093 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.538411 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.538741 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.539054 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.539383 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.539800 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.104 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.540053 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.104 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.540367 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.540751 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.541079 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.541394 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.541720 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.542047 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.542362 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.542676 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.547361 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.547361 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.547361 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.547361 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.547361 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.547361 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.547361 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.547361 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.549909 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.549909 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.549909 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.549909 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.549909 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.549909 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.549909 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.549909 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.551060 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.551060 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.551060 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.551060 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.551060 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.551060 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.551060 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.551060 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.552207 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.552207 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.552207 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.552207 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.552207 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.552981 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.552981 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.552981 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.553430 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.556787 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.556787 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.556787 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.556787 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.556787 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.556787 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.556787 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.556787 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.557990 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.557990 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.557990 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.557990 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.557990 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.557990 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.557990 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.559042 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.559042 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.559042 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.559042 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.559601 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.559601 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.560821 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.560821 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.560821 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.561051 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.561227 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.561571 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.561909 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.562269 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.562566 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.563610 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.563610 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.563610 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.563945 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.564471 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.564471 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.564715 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 09:47:46.565102 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.565194 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 09:47:46.565280 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.565376 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 09:47:46.565468 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.565705 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 09:47:46.565807 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.565964 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 09:47:46.566054 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.566336 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.566436 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.566661 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.566773 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.567000 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.567101 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.567323 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.567430 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.567638 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.567737 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.567964 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.568148 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.568295 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.568622 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.568985 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.569251 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.569573 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.569910 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815712-3-iscsi {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.570154 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.570255 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.570491 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.570591 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.570835 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.570947 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.571159 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.571470 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.571777 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.571881 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.572097 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.572189 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.572440 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.572619 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.572793 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.572964 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.573123 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.573280 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.573466 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.573599 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.573793 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.573955 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.574119 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.574336 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.574464 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.574576 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.574907 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.575221 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.575553 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.575870 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.576343 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815712-3-iscsi {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.576606 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.576979 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.577094 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.577312 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.577415 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.577641 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.577752 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.578135 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.578266 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.578472 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.578626 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.578780 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.579737 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.580079 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.580429 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.580777 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.580890 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.581120 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.581450 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.581775 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.581902 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.582093 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.582316 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.582535 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.582860 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.582964 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.583180 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.583510 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.583757 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.583957 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.584272 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.584388 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.584992 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.585430 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.585871 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.586275 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.586677 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.587023 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.587126 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.587353 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.587454 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.587683 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.587776 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.588028 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.588351 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.589561 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.590069 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.590321 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.590446 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.590607 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.590736 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.591069 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.591412 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.591742 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.592071 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.592423 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.592794 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.593115 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.593236 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.593928 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.594188 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.594347 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.594527 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.594629 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.594934 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.595104 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.595364 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.595459 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.595743 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.595841 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.596060 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.596161 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.596379 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.596470 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.596714 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.596810 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.597037 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.597142 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.597352 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.597450 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.597668 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.597759 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.597984 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.598076 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.598299 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.598390 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.598615 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.598713 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.598942 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.599038 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.599256 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.599348 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.104 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.599572 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.599679 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.104 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.599882 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.599981 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.600193 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.600284 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.600550 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.600642 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.600984 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.601091 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.601210 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.601303 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.601541 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.601639 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.601859 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.601958 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.602177 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.602275 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.602496 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.602595 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.602827 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.602926 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.603161 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.603258 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.603477 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.603672 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.603850 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.604009 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.604312 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.604482 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.604635 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.604872 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.605043 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.605197 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.605360 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.605773 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.605940 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.606112 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.606352 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.606575 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.606776 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.606986 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.607151 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.607364 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.607529 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.607689 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.607840 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.607992 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.608143 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.608143 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.608441 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.608592 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.608793 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.608948 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.609199 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.609463 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.609702 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.609963 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.610223 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.610508 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.610666 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.610666 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.610978 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.611131 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.611281 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.611432 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.611582 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.611744 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.611916 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.612078 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.612229 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.612380 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.612551 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.612832 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.613001 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.613348 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.613527 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.613691 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.613860 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.614072 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.614230 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.614408 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.614561 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.614712 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.614863 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.615051 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.615218 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.615389 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.615542 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.615926 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.616087 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.616248 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.616487 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.616688 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.616864 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.617025 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.617176 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.617329 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.617486 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.617656 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.617838 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.618001 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.618161 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.618320 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.618482 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.618711 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.619001 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.619161 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.619321 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.619496 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.619656 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.619816 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.619967 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.620118 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.620268 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.620433 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.620587 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.620791 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.620954 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.621118 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.621269 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.621432 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.621596 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.621748 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.621898 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.622056 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.622215 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:47:46.622381 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.622535 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.622693 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.622845 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.622997 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.623186 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.623349 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.623508 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.623661 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.623819 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.623980 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.624219 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.624380 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.624532 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.625243 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.625475 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.625739 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.626266 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.626437 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.626682 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.626848 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.627001 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.627151 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.627399 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.627562 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.627715 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.627867 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.628025 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.628204 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.628365 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.628538 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.628709 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.628869 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.629031 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.629192 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.629352 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.629512 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.629512 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.629798 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.629956 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.630121 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.630280 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.630431 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.630601 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.630829 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.630983 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.631143 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.631294 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.631451 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.631602 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.631753 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.631912 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.632064 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.632214 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.632364 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.632525 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.632525 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.633159 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.633328 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.633481 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.633632 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.633791 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.633942 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.634111 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.634272 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.634431 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.634431 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.634719 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.634889 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.635055 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.635223 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.635409 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.635569 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.635729 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.635895 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.636055 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.636443 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.636785 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.636947 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.637107 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.637107 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.637440 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.637591 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.637741 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.637901 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.637901 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.638212 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.638374 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.638374 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.639066 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.639227 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.639227 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.639530 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.639732 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.639732 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.640146 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.640982 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.640982 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.641522 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.641731 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.641731 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.642024 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.642175 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.642175 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.642553 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.642783 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.642783 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.643213 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.643457 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.643457 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.644029 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.644295 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.644547 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.644843 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.644843 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.645246 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.645450 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.645645 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.645831 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.646095 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.646671 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.646902 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.647086 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.647295 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.647471 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.647652 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.647829 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.648615 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.648815 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.648815 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.649004 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.649101 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.649188 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.649281 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.649366 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.649460 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.649546 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.649630 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.649722 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.649820 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.649912 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.650007 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.650094 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.650185 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.650185 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.650338 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.650429 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.650523 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.650616 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.650709 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.650794 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.650905 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.650988 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.650988 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.651160 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.651244 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.651334 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.651427 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.651521 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.651607 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.651691 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.651774 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.651857 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.651948 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.652049 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.652144 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.652230 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.652313 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.652396 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.652488 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.652587 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.652708 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.652797 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.652898 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.652991 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.653077 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.653173 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.653267 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.653359 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.653452 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.653538 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.653635 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.653721 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.653805 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.653888 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.653979 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.654065 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.654157 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.654252 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.654346 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.654440 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.654527 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.654619 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.654716 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.654802 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.654887 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.654970 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.655054 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.655137 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.655303 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.655303 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.655467 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.655554 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.655638 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.655736 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.655829 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.656213 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.656348 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.656348 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.656553 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.656842 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.656941 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.657037 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.657132 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.657132 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.657365 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.657466 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.657566 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.657659 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.657751 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.657844 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.658050 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.658155 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.658384 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.658478 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.658718 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.658819 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.659025 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.659131 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.659367 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.659479 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.659690 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.659785 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.660002 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.660096 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.660317 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.660411 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.660629 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.660773 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.661005 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.661106 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.661314 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.661415 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.661662 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.661763 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.661975 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.662068 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.662294 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.662396 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.662618 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.662718 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.662932 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.663032 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.663249 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.663342 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.663566 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.663676 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.663874 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.663980 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.664192 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.664302 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.664508 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.664611 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.664851 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.664946 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.665159 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.665264 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.665467 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.665570 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.665829 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.665920 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.666157 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.666250 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.666478 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.666581 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.666839 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.666949 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.667136 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.667236 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.667471 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.667566 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.667779 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.667874 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.668092 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.668206 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.668415 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.668521 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.668738 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.668836 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.669054 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.669156 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.669366 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.669469 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.669683 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.669778 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.669994 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.670086 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.670310 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.670411 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.670629 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.670727 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.670946 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.671058 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.671263 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.671365 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.671601 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.671714 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.671927 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.672113 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.672294 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.672459 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.672557 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.672726 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.672860 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.672969 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.673178 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.673279 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.673506 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.673599 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.673825 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.673928 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.674143 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.674242 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.674453 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.674555 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.674765 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.674922 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.675080 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.675215 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.675390 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.675533 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.675706 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.675834 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.676017 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.676157 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.676335 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.676513 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.676677 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.676825 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.677045 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.677173 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.677305 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.677425 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.677620 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.677758 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.677944 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.678088 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.678276 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.678420 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.678594 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.678731 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.678921 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.679058 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.679240 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.679385 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.679551 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.679704 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.679879 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.680023 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.680169 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.680328 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.680470 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.680611 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.680798 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.680935 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.681128 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.681616 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.681760 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.681894 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.682036 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.682177 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.682177 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.682443 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.682585 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.682718 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.682858 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.682991 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.683138 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.683286 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.683429 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.683569 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.683702 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.683835 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.684055 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.684199 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.684467 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.684610 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.684999 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.685192 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.685350 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.685524 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.685690 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.685825 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.685945 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.686055 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.686201 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.686344 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.686512 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.686650 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.686883 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.687083 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.687822 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.688015 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.688218 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.688422 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.688623 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.688895 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.689105 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.689314 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.689527 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.689753 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.689975 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.690158 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.690283 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.690283 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.690536 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.690678 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.690823 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.690956 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.691096 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.691230 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.691369 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.691509 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.691652 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.691865 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.692000 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.692142 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.692275 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.692434 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.692570 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.692755 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.692892 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.693031 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.693175 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.693309 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.693445 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.693586 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.693726 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.693870 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.694012 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.694145 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.694277 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.694409 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.694541 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.694690 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.694831 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.694954 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.695085 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.695224 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.695352 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.695498 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.695619 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.695738 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.695851 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.696070 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.696272 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.696415 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.696631 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.696822 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.696982 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.696982 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.697238 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.697238 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.697507 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.697640 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.697796 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.698006 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.698158 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.698292 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.698424 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.698424 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.698673 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.698814 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.698955 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.699096 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.699237 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.699377 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.699552 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.699676 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.699815 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.699956 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.700089 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.700247 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.700383 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.700563 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.700764 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.700899 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.701031 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.701207 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.701357 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.701504 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.701638 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.701818 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.701954 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.702126 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.702264 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.702441 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.702579 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.702769 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.703437 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.703708 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.703939 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.704207 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.704361 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.704503 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.704503 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.704794 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.704939 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.705061 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.705192 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.705332 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.705474 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.705608 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.705753 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.705895 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.706028 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.706182 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.706387 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.706531 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.706675 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.706809 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.706940 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.707080 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.707256 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.707397 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.707570 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.707715 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.707889 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.708047 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.708248 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.708399 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.708535 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.708699 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.708847 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.708989 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.709135 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.709278 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.709461 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.709608 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.709773 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.709926 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.710075 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.710206 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.710389 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.710517 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.710702 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.710838 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.711012 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.711153 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.711326 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.711462 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.711632 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.711769 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.711944 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.712088 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.712255 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.712406 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.712564 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.712748 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.712963 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.713107 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.713249 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.713458 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.713595 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.713736 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.713885 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.714018 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.714151 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.714406 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.714548 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.714747 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.714908 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.715044 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.715174 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.715362 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.715495 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.715703 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.715845 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.715986 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.716119 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.716299 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.716457 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.716620 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.717395 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.717547 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.717678 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.717820 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.717954 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.718095 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.718251 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.718972 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.719168 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.719399 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.719631 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.719820 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.719958 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.719958 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.720231 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.720376 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.720518 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.720692 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.720829 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.720974 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.721119 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.721253 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.721385 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.721525 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.721667 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.721802 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.721946 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.722092 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.722236 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.722377 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.722518 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.722658 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.722801 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.722934 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.723066 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.723197 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.723330 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.723476 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.723610 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.723752 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.723984 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.724121 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.724262 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.724410 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.724544 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.724697 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.724833 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.724964 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.725097 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.725221 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.725362 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.725474 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.725606 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.725746 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.725888 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.726035 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.726177 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.726310 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.726545 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.726714 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.726872 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.727012 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.727171 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.727306 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.727439 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.727625 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.727767 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.727944 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.728081 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.728317 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.728485 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.728815 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.728967 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.729099 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.729229 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.729358 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.729495 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.729641 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.729773 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.729903 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.730032 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.730199 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.730333 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.730509 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.730644 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.730866 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.731011 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.731166 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.731342 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.731501 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.731693 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.731834 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.731949 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.732060 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.732274 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.732406 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.732597 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.732751 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.732936 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.739380 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.739639 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.739774 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.739881 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.739980 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.740079 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.740168 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.740278 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.740375 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.740462 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.740546 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.740630 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.740743 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.740922 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.741011 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.741100 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.741186 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.741269 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.741353 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.741353 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.741521 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.741606 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.741690 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.741781 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.741880 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.741967 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.742058 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.742152 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.742244 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.742329 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.742422 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.742507 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.742591 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.742681 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.742774 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.742867 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.742961 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.743046 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.743139 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.743232 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.743318 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.743401 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.743492 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.743585 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.743676 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.743769 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.743854 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.743952 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.744038 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.744122 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.744122 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.744292 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.744384 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.744482 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.744574 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.744688 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.744777 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.744861 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.744957 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.745057 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.745153 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.745247 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.745333 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.745425 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.745511 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.745604 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.745686 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.745758 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.745839 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.745909 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.746005 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.746005 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.746158 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.746241 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.746324 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.746415 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.746509 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.746594 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.746679 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.746781 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.746871 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.746945 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.747024 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.747110 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.747190 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.747270 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.747367 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.747367 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.747539 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.747663 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.747773 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.747982 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.748207 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.748319 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.748591 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.748719 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.748942 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.749047 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.749251 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.749357 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.749582 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.750254 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.750475 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.750628 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.750784 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.750970 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.751097 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.751304 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.751406 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.751621 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.751732 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.751954 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.752048 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.752274 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.752375 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.752588 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.752732 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.752933 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.753036 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.753241 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.753342 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.753553 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.753657 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.753864 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.753966 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.754174 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.754268 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.754515 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.754622 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.754835 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.754930 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.755155 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.755263 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.755471 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.755565 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.755792 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.755889 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.756101 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.756195 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.756413 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.756545 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.756746 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.756845 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.757060 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.757153 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.757379 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.757482 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.757696 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.757788 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.758008 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.758113 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.758312 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.758422 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.758670 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.758826 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.758922 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.759146 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.759258 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.759464 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.759564 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.759787 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.759888 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.760098 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.760204 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.760466 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.760565 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.760818 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.760912 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.761141 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.761237 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.761466 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.761560 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.761779 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.761881 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.762155 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.762261 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.762445 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.762544 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.762755 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.762860 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.763093 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.763185 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.763401 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.763766 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.763971 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.764074 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.764277 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.764378 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.764589 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.764747 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.764952 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.765061 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.765295 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.765413 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.766132 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.766234 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.766448 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.766563 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.766797 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.766969 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.767070 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.767302 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.767416 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.767631 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.767736 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.767973 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.768079 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.768292 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.768455 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.768616 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.768783 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.768968 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.769125 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.769353 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.769575 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.769709 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.769874 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.770008 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.770208 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.770352 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.770518 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.770656 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.770838 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.770970 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.771158 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.771306 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.771462 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.771596 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.771787 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.771970 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.772166 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.772313 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.772430 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.772550 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.772741 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.772863 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.773800 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.773947 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.774079 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.774209 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.774339 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.774467 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.774614 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.774746 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.774876 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.775006 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.775136 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.775265 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.775405 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.775544 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.775684 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.776036 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.776188 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.776332 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.776475 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.776694 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.776847 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.776961 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.777093 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.777315 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.777451 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.777572 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.777685 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.777798 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.777918 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.778156 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.778336 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.778470 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.778585 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123069) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 09:47:46.778724 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.778874 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.779067 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.779402 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.779703 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.780027 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.780349 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.780701 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.781079 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.781412 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.781767 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.782051 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.782373 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.782921 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.783348 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.783706 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.784039 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.784374 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.784730 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.785064 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.785976 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.785976 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.786258 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.786398 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.786634 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.787054 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.787268 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.787586 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.787898 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.788228 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.788544 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.789179 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.789661 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.789818 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.790141 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.790559 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.790794 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.791201 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.791440 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.791753 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.792068 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.792394 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.792991 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.793148 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.793349 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.793668 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.793984 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.794294 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.794611 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.794922 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.795257 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.795570 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.795981 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.796295 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.796645 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.796984 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.797296 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.797684 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.797986 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.798241 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.798505 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.798819 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.799171 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.799470 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.799845 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.800073 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.800384 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.800802 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.801076 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_db.sqlalchemy.engines [None req-e3055cfd-3ddf-40ee-9794-3d890ef6edf1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123069) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:47:46.801284 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.801487 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.801714 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.802032 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.802361 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.802682 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.803002 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.803366 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.803691 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.804278 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.804884 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.805023 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.808318 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.808318 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.808318 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.808318 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.808318 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.808318 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.808318 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.808318 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.810138 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.810138 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.810138 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.810138 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.810138 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.810138 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.810138 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.811065 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.811065 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.811065 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.811706 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.811706 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.811981 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.812890 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.813096 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.813358 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.813687 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.814137 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.814466 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.814783 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.815231 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.815556 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.815886 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.816217 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.816537 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.816894 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.817232 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.817560 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.817949 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.818275 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.818610 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.818960 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.819298 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.819632 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.819978 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.820406 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.820729 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.820901 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.821242 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.821564 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.821897 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.822213 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.822543 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.822887 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.823189 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.823516 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.823922 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.824238 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.824578 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.825053 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.825296 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.825561 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.825876 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.826191 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.826507 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.826842 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.827177 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.827496 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.827937 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.827937 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.827937 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.829672 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.829815 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.830135 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.830451 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.830762 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.831073 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.831505 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.831719 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.832067 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.832377 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.832736 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.833073 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.833407 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.833776 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.834097 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.834453 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.834788 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:47:46.835040 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 09:47:46.858597 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_db.sqlalchemy.engines [None req-34599c8b-6d27-4ad4-9b9e-908975290a0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123068) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:47:46.883885 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.context [None req-e3055cfd-3ddf-40ee-9794-3d890ef6edf1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),356e6bf2-a214-4629-b73a-1cdeb48ef84c(cell1) {{(pid=123069) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 09:47:46.888710 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e3055cfd-3ddf-40ee-9794-3d890ef6edf1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:47:46.890524 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e3055cfd-3ddf-40ee-9794-3d890ef6edf1 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:47:46.891359 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e3055cfd-3ddf-40ee-9794-3d890ef6edf1 None None] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:47:46.893344 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e3055cfd-3ddf-40ee-9794-3d890ef6edf1 None None] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:47:46.904077 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_db.sqlalchemy.engines [None req-e3055cfd-3ddf-40ee-9794-3d890ef6edf1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123069) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:47:46.907449 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_db.sqlalchemy.engines [None req-e3055cfd-3ddf-40ee-9794-3d890ef6edf1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123069) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:47:46.943624 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.context [None req-34599c8b-6d27-4ad4-9b9e-908975290a0d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),356e6bf2-a214-4629-b73a-1cdeb48ef84c(cell1) {{(pid=123068) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 09:47:46.948086 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-34599c8b-6d27-4ad4-9b9e-908975290a0d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:47:46.949720 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-34599c8b-6d27-4ad4-9b9e-908975290a0d None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:47:46.950565 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-34599c8b-6d27-4ad4-9b9e-908975290a0d None None] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:47:46.952514 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-34599c8b-6d27-4ad4-9b9e-908975290a0d None None] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:47:46.963731 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_db.sqlalchemy.engines [None req-34599c8b-6d27-4ad4-9b9e-908975290a0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123068) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:47:46.964871 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_db.sqlalchemy.engines [None req-34599c8b-6d27-4ad4-9b9e-908975290a0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123068) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:47:47.176990 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_db.sqlalchemy.engines [None req-e3055cfd-3ddf-40ee-9794-3d890ef6edf1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123069) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:47:47.232163 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_db.sqlalchemy.engines [None req-34599c8b-6d27-4ad4-9b9e-908975290a0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123068) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:47:47.531735 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: WARNING keystonemiddleware.auth_token [None req-e3055cfd-3ddf-40ee-9794-3d890ef6edf1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 09:47:47.538239 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: WARNING keystonemiddleware.auth_token [None req-e3055cfd-3ddf-40ee-9794-3d890ef6edf1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 09:47:47.586856 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: WARNING keystonemiddleware.auth_token [None req-34599c8b-6d27-4ad4-9b9e-908975290a0d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 09:47:47.593877 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: WARNING keystonemiddleware.auth_token [None req-34599c8b-6d27-4ad4-9b9e-908975290a0d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 09:47:47.898182 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: WARNING keystonemiddleware.auth_token [None req-e3055cfd-3ddf-40ee-9794-3d890ef6edf1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 09:47:47.903477 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: WARNING keystonemiddleware.auth_token [None req-e3055cfd-3ddf-40ee-9794-3d890ef6edf1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 09:47:47.908968 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a7bc19e9c0 pid: 123069 (default app) Oct 28 09:47:47.947543 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: WARNING keystonemiddleware.auth_token [None req-34599c8b-6d27-4ad4-9b9e-908975290a0d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 09:47:47.953167 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: WARNING keystonemiddleware.auth_token [None req-34599c8b-6d27-4ad4-9b9e-908975290a0d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 09:47:47.958374 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a7bc19e9c0 pid: 123068 (default app) Oct 28 09:48:26.477696 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-fe0ee3ce-0228-49be-bbe7-2b93abfec433 tempest-VolumesGetTestJSON-1879371872 tempest-VolumesGetTestJSON-1879371872-project] Action: 'create', calling method: .version_select at 0x7fe123c7ff70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-356572838", "metadata": {"Type": "work"}}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:48:27.879994 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-32e27c3a-d74d-4ab1-b617-d2215f447a06 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1712307920", "imageRef": "623b30fc-1d92-46d9-b556-b9b963f3d76c", "flavorRef": "452", "networks": [{"uuid": "0e2c1e93-f1e0-47eb-a7fd-8b3bdd4ba2da"}]}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:48:28.363128 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.network.neutron [None req-32e27c3a-d74d-4ab1-b617-d2215f447a06 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] validate_networks() for [('0e2c1e93-f1e0-47eb-a7fd-8b3bdd4ba2da', None, None, None, None, None)] {{(pid=123068) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 09:48:29.419435 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-fe0ee3ce-0228-49be-bbe7-2b93abfec433 tempest-VolumesGetTestJSON-1879371872 tempest-VolumesGetTestJSON-1879371872-project] 10.222.0.104 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.636588 Oct 28 09:48:29.435383 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 1/1] 10.222.0.104 () {60 vars in 1160 bytes} [Thu Oct 28 09:48:24 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 4654 msecs (HTTP/1.1 200) 10 headers in 449 bytes (2 switches on core 0) Oct 28 09:48:29.441675 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-cc4d0812-8266-4b1a-a4df-3ada32e6e062 tempest-VolumesGetTestJSON-1879371872 tempest-VolumesGetTestJSON-1879371872-project] Calling method '.version_select at 0x7fe123adbaf0>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:29.844014 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-cc4d0812-8266-4b1a-a4df-3ada32e6e062 tempest-VolumesGetTestJSON-1879371872 tempest-VolumesGetTestJSON-1879371872-project] 10.222.0.104 "GET /compute/v2.1/os-volumes/bdcb5c69-d98e-4126-9dd5-27818af938f2" status: 200 len: 352 microversion: 2.1 time: 0.406463 Oct 28 09:48:29.844203 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-32e27c3a-d74d-4ab1-b617-d2215f447a06 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Flavor limits 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:48:29.845232 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-32e27c3a-d74d-4ab1-b617-d2215f447a06 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Image limits 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:48:29.845232 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-32e27c3a-d74d-4ab1-b617-d2215f447a06 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Flavor pref 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:48:29.845441 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-32e27c3a-d74d-4ab1-b617-d2215f447a06 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Image pref 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:48:29.846081 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-32e27c3a-d74d-4ab1-b617-d2215f447a06 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:48:29.847254 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 2/2] 10.222.0.104 () {58 vars in 1249 bytes} [Thu Oct 28 09:48:29 2021] GET /compute/v2.1/os-volumes/bdcb5c69-d98e-4126-9dd5-27818af938f2 => generated 352 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:48:29.877956 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-32e27c3a-d74d-4ab1-b617-d2215f447a06 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:29.878771 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-32e27c3a-d74d-4ab1-b617-d2215f447a06 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:29.879883 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-32e27c3a-d74d-4ab1-b617-d2215f447a06 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:29.881715 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-32e27c3a-d74d-4ab1-b617-d2215f447a06 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:29.935012 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.quota [None req-32e27c3a-d74d-4ab1-b617-d2215f447a06 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Getting quotas for project e6bfc73417aa4dacaee5ea501175efb5. Resources: {'ram', 'cores', 'instances'} {{(pid=123068) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 09:48:29.944533 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.quota [None req-32e27c3a-d74d-4ab1-b617-d2215f447a06 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Getting quotas for user 2eb58dd8c77b4808b54874f4dac8501e and project e6bfc73417aa4dacaee5ea501175efb5. Resources: {'ram', 'cores', 'instances'} {{(pid=123068) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 09:48:29.959501 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-32e27c3a-d74d-4ab1-b617-d2215f447a06 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Going to run 1 instances... {{(pid=123068) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 09:48:29.962963 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-32e27c3a-d74d-4ab1-b617-d2215f447a06 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='623b30fc-1d92-46d9-b556-b9b963f3d76c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 09:48:30.212770 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-32e27c3a-d74d-4ab1-b617-d2215f447a06 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] 10.222.0.104 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 4.131285 Oct 28 09:48:30.214418 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 1/3] 10.222.0.104 () {60 vars in 1151 bytes} [Thu Oct 28 09:48:26 2021] POST /compute/v2.1/servers => generated 382 bytes in 4135 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 28 09:48:30.228021 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-dfd7aead-1616-44f4-9423-10c0708df56c tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:30.229083 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-dfd7aead-1616-44f4-9423-10c0708df56c tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:30.435040 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-dfd7aead-1616-44f4-9423-10c0708df56c tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb58dd8c77b4808b54874f4dac8501e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bfc73417aa4dacaee5ea501175efb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:30.454483 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-dfd7aead-1616-44f4-9423-10c0708df56c tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] 10.222.0.104 "GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b" status: 200 len: 1219 microversion: 2.1 time: 0.230389 Oct 28 09:48:30.467684 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 3/4] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:48:30 2021] GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b => generated 1219 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:30.859007 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-40b36a90-9fc3-4803-a8ed-0462af3e965d tempest-VolumesGetTestJSON-1879371872 tempest-VolumesGetTestJSON-1879371872-project] Calling method '.version_select at 0x7fe1232018b0>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:31.474262 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-222add52-c46e-4389-8c04-e7899b11719a tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:31.474836 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-222add52-c46e-4389-8c04-e7899b11719a tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:31.536728 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-222add52-c46e-4389-8c04-e7899b11719a tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb58dd8c77b4808b54874f4dac8501e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bfc73417aa4dacaee5ea501175efb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:31.544628 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-222add52-c46e-4389-8c04-e7899b11719a tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] 10.222.0.104 "GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b" status: 200 len: 1219 microversion: 2.1 time: 0.073959 Oct 28 09:48:31.558107 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 4/5] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:48:31 2021] GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:31.679472 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-40b36a90-9fc3-4803-a8ed-0462af3e965d tempest-VolumesGetTestJSON-1879371872 tempest-VolumesGetTestJSON-1879371872-project] 10.222.0.104 "GET /compute/v2.1/os-volumes/bdcb5c69-d98e-4126-9dd5-27818af938f2" status: 200 len: 353 microversion: 2.1 time: 0.825071 Oct 28 09:48:31.680488 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 2/6] 10.222.0.104 () {58 vars in 1249 bytes} [Thu Oct 28 09:48:30 2021] GET /compute/v2.1/os-volumes/bdcb5c69-d98e-4126-9dd5-27818af938f2 => generated 353 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:48:31.695113 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-66ed1f6d-defd-4ed2-ae4e-c3bdb874c734 tempest-VolumesGetTestJSON-1879371872 tempest-VolumesGetTestJSON-1879371872-project] Calling method '.version_select at 0x7fe123ab5ee0>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:32.141259 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-66ed1f6d-defd-4ed2-ae4e-c3bdb874c734 tempest-VolumesGetTestJSON-1879371872 tempest-VolumesGetTestJSON-1879371872-project] 10.222.0.104 "GET /compute/v2.1/os-volumes/bdcb5c69-d98e-4126-9dd5-27818af938f2" status: 200 len: 353 microversion: 2.1 time: 0.451583 Oct 28 09:48:32.142444 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 5/7] 10.222.0.104 () {58 vars in 1249 bytes} [Thu Oct 28 09:48:31 2021] GET /compute/v2.1/os-volumes/bdcb5c69-d98e-4126-9dd5-27818af938f2 => generated 353 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:48:32.158837 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-e0860ccc-7621-4d77-bae1-f9166eff2ebb tempest-VolumesGetTestJSON-1879371872 tempest-VolumesGetTestJSON-1879371872-project] Calling method '.version_select at 0x7fe123afedc0>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:32.565736 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-e0860ccc-7621-4d77-bae1-f9166eff2ebb tempest-VolumesGetTestJSON-1879371872 tempest-VolumesGetTestJSON-1879371872-project] 10.222.0.104 "DELETE /compute/v2.1/os-volumes/bdcb5c69-d98e-4126-9dd5-27818af938f2" status: 202 len: 0 microversion: 2.1 time: 0.410830 Oct 28 09:48:32.571148 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 3/8] 10.222.0.104 () {58 vars in 1252 bytes} [Thu Oct 28 09:48:32 2021] DELETE /compute/v2.1/os-volumes/bdcb5c69-d98e-4126-9dd5-27818af938f2 => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:48:32.583762 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-2c56b472-7fc8-40b1-aa21-55e60c8808a5 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:32.585116 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-2c56b472-7fc8-40b1-aa21-55e60c8808a5 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:32.596335 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-ccc2f6d5-bfbb-43db-88e1-a19835a2159b tempest-VolumesGetTestJSON-1879371872 tempest-VolumesGetTestJSON-1879371872-project] Calling method '.version_select at 0x7fe1229f79d0>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:32.758946 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-2c56b472-7fc8-40b1-aa21-55e60c8808a5 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb58dd8c77b4808b54874f4dac8501e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bfc73417aa4dacaee5ea501175efb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:32.780355 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-2c56b472-7fc8-40b1-aa21-55e60c8808a5 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] 10.222.0.104 "GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b" status: 200 len: 1219 microversion: 2.1 time: 0.218192 Oct 28 09:48:32.782626 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 6/9] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:48:32 2021] GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b => generated 1219 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:32.810723 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-ccc2f6d5-bfbb-43db-88e1-a19835a2159b tempest-VolumesGetTestJSON-1879371872 tempest-VolumesGetTestJSON-1879371872-project] 10.222.0.104 "GET /compute/v2.1/os-volumes/bdcb5c69-d98e-4126-9dd5-27818af938f2" status: 200 len: 352 microversion: 2.1 time: 0.234889 Oct 28 09:48:32.812208 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 4/10] 10.222.0.104 () {58 vars in 1249 bytes} [Thu Oct 28 09:48:32 2021] GET /compute/v2.1/os-volumes/bdcb5c69-d98e-4126-9dd5-27818af938f2 => generated 352 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:48:33.801409 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-408fc62e-f002-4eea-99d7-fb5fcac45343 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:33.802666 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-408fc62e-f002-4eea-99d7-fb5fcac45343 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:33.816748 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-408fc62e-f002-4eea-99d7-fb5fcac45343 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:33.819687 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-408fc62e-f002-4eea-99d7-fb5fcac45343 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:33.820286 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-408fc62e-f002-4eea-99d7-fb5fcac45343 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:33.820882 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-408fc62e-f002-4eea-99d7-fb5fcac45343 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:33.836425 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-86d6c951-b909-429f-8fab-0b44c99983ac tempest-VolumesGetTestJSON-1879371872 tempest-VolumesGetTestJSON-1879371872-project] Calling method '.version_select at 0x7fe122981310>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:34.033817 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-408fc62e-f002-4eea-99d7-fb5fcac45343 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb58dd8c77b4808b54874f4dac8501e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bfc73417aa4dacaee5ea501175efb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:34.050799 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-408fc62e-f002-4eea-99d7-fb5fcac45343 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] 10.222.0.104 "GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b" status: 200 len: 1223 microversion: 2.1 time: 0.253284 Oct 28 09:48:34.051524 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 7/11] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:48:33 2021] GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b => generated 1223 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:34.284066 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.wsgi [None req-86d6c951-b909-429f-8fab-0b44c99983ac tempest-VolumesGetTestJSON-1879371872 tempest-VolumesGetTestJSON-1879371872-project] HTTP exception thrown: Volume bdcb5c69-d98e-4126-9dd5-27818af938f2 could not be found. Oct 28 09:48:34.284457 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-86d6c951-b909-429f-8fab-0b44c99983ac tempest-VolumesGetTestJSON-1879371872 tempest-VolumesGetTestJSON-1879371872-project] Returning 404 to user: Volume bdcb5c69-d98e-4126-9dd5-27818af938f2 could not be found. {{(pid=123068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:48:34.285456 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-86d6c951-b909-429f-8fab-0b44c99983ac tempest-VolumesGetTestJSON-1879371872 tempest-VolumesGetTestJSON-1879371872-project] 10.222.0.104 "GET /compute/v2.1/os-volumes/bdcb5c69-d98e-4126-9dd5-27818af938f2" status: 404 len: 109 microversion: 2.1 time: 0.453723 Oct 28 09:48:34.289967 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 5/12] 10.222.0.104 () {58 vars in 1249 bytes} [Thu Oct 28 09:48:33 2021] GET /compute/v2.1/os-volumes/bdcb5c69-d98e-4126-9dd5-27818af938f2 => generated 109 bytes in 459 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:48:35.069148 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-319005cc-84a2-4227-b6b6-9b3a07fd3db2 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:35.069926 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-319005cc-84a2-4227-b6b6-9b3a07fd3db2 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:35.077672 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-319005cc-84a2-4227-b6b6-9b3a07fd3db2 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:35.081371 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-319005cc-84a2-4227-b6b6-9b3a07fd3db2 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:35.087721 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-319005cc-84a2-4227-b6b6-9b3a07fd3db2 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:35.088189 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-319005cc-84a2-4227-b6b6-9b3a07fd3db2 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:35.190125 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-319005cc-84a2-4227-b6b6-9b3a07fd3db2 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb58dd8c77b4808b54874f4dac8501e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bfc73417aa4dacaee5ea501175efb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:35.214628 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-319005cc-84a2-4227-b6b6-9b3a07fd3db2 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] 10.222.0.104 "GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b" status: 200 len: 1271 microversion: 2.1 time: 0.149408 Oct 28 09:48:35.217932 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 8/13] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:48:35 2021] GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b => generated 1271 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:36.422232 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-3499577d-a0cb-41f6-a8df-9d4901913400 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'create', calling method: .version_select at 0x7fe1229f7a60>, body: {"keypair": {"name": "tempest-keypair-1508598530"}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:48:36.424324 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-281c4c87-f21f-45ba-8cb2-70c3d9483bf1 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:36.424324 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-281c4c87-f21f-45ba-8cb2-70c3d9483bf1 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:36.427417 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.quota [None req-3499577d-a0cb-41f6-a8df-9d4901913400 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Getting quotas for project 8d7839b812b745549a72a1e089b6f4e9. Resources: {'key_pairs'} {{(pid=123068) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 09:48:36.429038 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-281c4c87-f21f-45ba-8cb2-70c3d9483bf1 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:36.429038 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-281c4c87-f21f-45ba-8cb2-70c3d9483bf1 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:36.429038 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-281c4c87-f21f-45ba-8cb2-70c3d9483bf1 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:36.429038 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-281c4c87-f21f-45ba-8cb2-70c3d9483bf1 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:36.433126 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.quota [None req-3499577d-a0cb-41f6-a8df-9d4901913400 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Getting quotas for user 62731dd3e3c54a73b941292530dfa850 and project 8d7839b812b745549a72a1e089b6f4e9. Resources: {'key_pairs'} {{(pid=123068) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 09:48:36.511975 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-281c4c87-f21f-45ba-8cb2-70c3d9483bf1 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb58dd8c77b4808b54874f4dac8501e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bfc73417aa4dacaee5ea501175efb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:36.532770 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-281c4c87-f21f-45ba-8cb2-70c3d9483bf1 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] 10.222.0.104 "GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b" status: 200 len: 1271 microversion: 2.1 time: 0.302060 Oct 28 09:48:36.535962 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 9/14] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:48:36 2021] GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b => generated 1271 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:36.766140 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-9b1ddafe-1560-4c20-9b14-0824edacb370 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'create', calling method: .version_select at 0x7fe123984ee0>, body: {"keypair": {"name": "tempest-keypair-1154370673"}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:48:36.951983 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.quota [None req-9b1ddafe-1560-4c20-9b14-0824edacb370 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Getting quotas for project 137c34c5941c4c86801a0e6b8b5c2f67. Resources: {'key_pairs'} {{(pid=123069) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 09:48:36.972800 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.quota [None req-9b1ddafe-1560-4c20-9b14-0824edacb370 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Getting quotas for user 2dc1f105c9714526a2a0fb7b51d93102 and project 137c34c5941c4c86801a0e6b8b5c2f67. Resources: {'key_pairs'} {{(pid=123069) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 09:48:37.325904 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.quota [None req-3499577d-a0cb-41f6-a8df-9d4901913400 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Getting quotas for project 8d7839b812b745549a72a1e089b6f4e9. Resources: {'key_pairs'} {{(pid=123068) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 09:48:37.337012 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.quota [None req-3499577d-a0cb-41f6-a8df-9d4901913400 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Getting quotas for user 62731dd3e3c54a73b941292530dfa850 and project 8d7839b812b745549a72a1e089b6f4e9. Resources: {'key_pairs'} {{(pid=123068) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 09:48:37.390343 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-3499577d-a0cb-41f6-a8df-9d4901913400 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.818717 Oct 28 09:48:37.391656 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 6/15] 10.222.0.104 () {60 vars in 1162 bytes} [Thu Oct 28 09:48:35 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:37.556479 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-fee8479b-c99b-40ee-aea7-788355af22ff tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:37.557771 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-fee8479b-c99b-40ee-aea7-788355af22ff tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:37.583667 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fee8479b-c99b-40ee-aea7-788355af22ff tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:37.585641 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fee8479b-c99b-40ee-aea7-788355af22ff tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:37.586507 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fee8479b-c99b-40ee-aea7-788355af22ff tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:37.587089 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fee8479b-c99b-40ee-aea7-788355af22ff tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:37.808078 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.quota [None req-9b1ddafe-1560-4c20-9b14-0824edacb370 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Getting quotas for project 137c34c5941c4c86801a0e6b8b5c2f67. Resources: {'key_pairs'} {{(pid=123069) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 09:48:37.823965 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.quota [None req-9b1ddafe-1560-4c20-9b14-0824edacb370 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Getting quotas for user 2dc1f105c9714526a2a0fb7b51d93102 and project 137c34c5941c4c86801a0e6b8b5c2f67. Resources: {'key_pairs'} {{(pid=123069) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 09:48:37.868507 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-9b1ddafe-1560-4c20-9b14-0824edacb370 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 1.275184 Oct 28 09:48:37.870484 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 10/16] 10.222.0.104 () {62 vars in 1203 bytes} [Thu Oct 28 09:48:36 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1278 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Oct 28 09:48:37.898614 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-fee8479b-c99b-40ee-aea7-788355af22ff tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb58dd8c77b4808b54874f4dac8501e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bfc73417aa4dacaee5ea501175efb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:37.946994 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-fee8479b-c99b-40ee-aea7-788355af22ff tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] 10.222.0.104 "GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b" status: 200 len: 1271 microversion: 2.1 time: 0.397820 Oct 28 09:48:37.954073 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 7/17] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:48:37 2021] GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b => generated 1271 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:38.973356 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-a419bd6d-31c7-4d6d-96ba-48e623a8a841 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:38.973988 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-a419bd6d-31c7-4d6d-96ba-48e623a8a841 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:38.989604 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a419bd6d-31c7-4d6d-96ba-48e623a8a841 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:38.991991 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a419bd6d-31c7-4d6d-96ba-48e623a8a841 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:39.000920 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a419bd6d-31c7-4d6d-96ba-48e623a8a841 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:39.002048 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a419bd6d-31c7-4d6d-96ba-48e623a8a841 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:39.244468 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-a419bd6d-31c7-4d6d-96ba-48e623a8a841 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb58dd8c77b4808b54874f4dac8501e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bfc73417aa4dacaee5ea501175efb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:39.265490 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-a419bd6d-31c7-4d6d-96ba-48e623a8a841 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] 10.222.0.104 "GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b" status: 200 len: 1277 microversion: 2.1 time: 0.296914 Oct 28 09:48:39.269765 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 11/18] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:48:38 2021] GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b => generated 1277 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:40.291981 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-6f44408e-9024-4425-9b64-2b96aea1848f tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:40.292932 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-6f44408e-9024-4425-9b64-2b96aea1848f tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:40.301099 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6f44408e-9024-4425-9b64-2b96aea1848f tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:40.301760 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6f44408e-9024-4425-9b64-2b96aea1848f tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:40.302774 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6f44408e-9024-4425-9b64-2b96aea1848f tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:40.303578 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6f44408e-9024-4425-9b64-2b96aea1848f tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:40.455266 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-6f44408e-9024-4425-9b64-2b96aea1848f tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb58dd8c77b4808b54874f4dac8501e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bfc73417aa4dacaee5ea501175efb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:40.467375 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-6f44408e-9024-4425-9b64-2b96aea1848f tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] 10.222.0.104 "GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b" status: 200 len: 1277 microversion: 2.1 time: 0.179146 Oct 28 09:48:40.471815 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 8/19] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:48:40 2021] GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b => generated 1277 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:41.488851 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-ee57347c-0dcc-4564-bf95-d5f9f338721b tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:41.489439 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-ee57347c-0dcc-4564-bf95-d5f9f338721b tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:41.498518 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ee57347c-0dcc-4564-bf95-d5f9f338721b tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:41.498967 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ee57347c-0dcc-4564-bf95-d5f9f338721b tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:41.499848 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ee57347c-0dcc-4564-bf95-d5f9f338721b tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:41.500278 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ee57347c-0dcc-4564-bf95-d5f9f338721b tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:42.763825 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-ee57347c-0dcc-4564-bf95-d5f9f338721b tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb58dd8c77b4808b54874f4dac8501e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bfc73417aa4dacaee5ea501175efb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:42.775058 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-ee57347c-0dcc-4564-bf95-d5f9f338721b tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] 10.222.0.104 "GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b" status: 200 len: 1319 microversion: 2.1 time: 1.290791 Oct 28 09:48:42.777488 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 12/20] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:48:41 2021] GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b => generated 1319 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:43.797484 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-63804d29-8186-4592-8c28-70a3af49b802 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:43.798269 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-63804d29-8186-4592-8c28-70a3af49b802 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:43.831269 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-63804d29-8186-4592-8c28-70a3af49b802 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:43.831812 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-63804d29-8186-4592-8c28-70a3af49b802 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:43.835729 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-63804d29-8186-4592-8c28-70a3af49b802 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:43.841691 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-63804d29-8186-4592-8c28-70a3af49b802 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:44.534355 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-63804d29-8186-4592-8c28-70a3af49b802 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb58dd8c77b4808b54874f4dac8501e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bfc73417aa4dacaee5ea501175efb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:44.543180 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-63804d29-8186-4592-8c28-70a3af49b802 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] 10.222.0.104 "GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b" status: 200 len: 1319 microversion: 2.1 time: 0.751131 Oct 28 09:48:44.547834 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 9/21] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:48:43 2021] GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b => generated 1319 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:44.643132 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [req-403991d7-21a8-4ebb-9219-01a42c33bbaf req-e6dbdaa8-e830-4285-96b8-9a6c8f054e8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5350c012-82d4-49d1-8b70-4eb8fb4d242b", "tag": "5874a229-cd52-4a12-9711-544832ced32e"}]} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:48:44.645766 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:48:44.645766 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 09:48:44.694251 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-403991d7-21a8-4ebb-9219-01a42c33bbaf req-e6dbdaa8-e830-4285-96b8-9a6c8f054e8e service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:44.694699 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-403991d7-21a8-4ebb-9219-01a42c33bbaf req-e6dbdaa8-e830-4285-96b8-9a6c8f054e8e service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:44.783109 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.compute.server_external_events [req-403991d7-21a8-4ebb-9219-01a42c33bbaf req-e6dbdaa8-e830-4285-96b8-9a6c8f054e8e service nova] Creating event network-changed:5874a229-cd52-4a12-9711-544832ced32e for instance 5350c012-82d4-49d1-8b70-4eb8fb4d242b on hv-cinder-81571 Oct 28 09:48:44.783699 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-403991d7-21a8-4ebb-9219-01a42c33bbaf req-e6dbdaa8-e830-4285-96b8-9a6c8f054e8e service nova] Acquired lock "compute-rpcapi-router" {{(pid=123069) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Oct 28 09:48:44.797062 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d2a07e8a-7590-425d-9d8a-93545751a93f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:44.797784 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d2a07e8a-7590-425d-9d8a-93545751a93f None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:44.798846 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d2a07e8a-7590-425d-9d8a-93545751a93f None None] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:44.799459 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d2a07e8a-7590-425d-9d8a-93545751a93f None None] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:44.849703 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.compute.rpcapi [None req-d2a07e8a-7590-425d-9d8a-93545751a93f None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Oct 28 09:48:44.851517 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d2a07e8a-7590-425d-9d8a-93545751a93f None None] Releasing lock "compute-rpcapi-router" {{(pid=123069) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Oct 28 09:48:44.895249 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-b1af7782-c3da-48ee-a4ac-90fdbb8393a5 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-346664955", "imageRef": "623b30fc-1d92-46d9-b556-b9b963f3d76c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c35fd8ce-1440-413c-a793-3622068b4395"}], "security_groups": [{"name": "tempest-securitygroup--670069587"}], "key_name": "tempest-keypair-1508598530", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:48:44.895841 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-d2a07e8a-7590-425d-9d8a-93545751a93f None None] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.426538 Oct 28 09:48:44.896319 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 13/22] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:48:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:48:45.430283 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.network.neutron [None req-b1af7782-c3da-48ee-a4ac-90fdbb8393a5 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] validate_networks() for [('c35fd8ce-1440-413c-a793-3622068b4395', None, None, None, None, None)] {{(pid=123068) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 09:48:45.566815 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-8c5e5b17-f456-4cb9-98e0-f7ef843f6748 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:45.567817 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-8c5e5b17-f456-4cb9-98e0-f7ef843f6748 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:45.588108 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8c5e5b17-f456-4cb9-98e0-f7ef843f6748 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:45.594763 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8c5e5b17-f456-4cb9-98e0-f7ef843f6748 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:45.596749 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8c5e5b17-f456-4cb9-98e0-f7ef843f6748 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:45.597964 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8c5e5b17-f456-4cb9-98e0-f7ef843f6748 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:45.935107 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-8c5e5b17-f456-4cb9-98e0-f7ef843f6748 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb58dd8c77b4808b54874f4dac8501e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bfc73417aa4dacaee5ea501175efb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:45.947452 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-8c5e5b17-f456-4cb9-98e0-f7ef843f6748 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] 10.222.0.104 "GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b" status: 200 len: 1319 microversion: 2.1 time: 0.387072 Oct 28 09:48:45.948241 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 14/23] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:48:45 2021] GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b => generated 1319 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:46.196420 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-507f3bf9-3b80-4728-9a6d-d664a4604f52 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1130873798", "imageRef": "623b30fc-1d92-46d9-b556-b9b963f3d76c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "260cb37c-589d-4ef2-92eb-ce6dad8a9c4c"}], "security_groups": [{"name": "tempest-securitygroup--2141394352"}], "key_name": "tempest-keypair-1154370673", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:48:46.251476 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-b1af7782-c3da-48ee-a4ac-90fdbb8393a5 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Flavor limits 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:48:46.252053 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-b1af7782-c3da-48ee-a4ac-90fdbb8393a5 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Image limits 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:48:46.253686 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-b1af7782-c3da-48ee-a4ac-90fdbb8393a5 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Flavor pref 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:48:46.260830 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-b1af7782-c3da-48ee-a4ac-90fdbb8393a5 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Image pref 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:48:46.260830 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-b1af7782-c3da-48ee-a4ac-90fdbb8393a5 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:48:46.275068 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b1af7782-c3da-48ee-a4ac-90fdbb8393a5 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:46.278428 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b1af7782-c3da-48ee-a4ac-90fdbb8393a5 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:46.280868 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b1af7782-c3da-48ee-a4ac-90fdbb8393a5 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:46.282378 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b1af7782-c3da-48ee-a4ac-90fdbb8393a5 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:46.339388 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.quota [None req-b1af7782-c3da-48ee-a4ac-90fdbb8393a5 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Getting quotas for project 8d7839b812b745549a72a1e089b6f4e9. Resources: {'ram', 'cores', 'instances'} {{(pid=123068) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 09:48:46.345320 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.quota [None req-b1af7782-c3da-48ee-a4ac-90fdbb8393a5 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Getting quotas for user 62731dd3e3c54a73b941292530dfa850 and project 8d7839b812b745549a72a1e089b6f4e9. Resources: {'ram', 'cores', 'instances'} {{(pid=123068) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 09:48:46.375284 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-b1af7782-c3da-48ee-a4ac-90fdbb8393a5 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Going to run 1 instances... {{(pid=123068) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 09:48:46.385024 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-b1af7782-c3da-48ee-a4ac-90fdbb8393a5 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='623b30fc-1d92-46d9-b556-b9b963f3d76c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 09:48:46.430217 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.network.neutron [None req-507f3bf9-3b80-4728-9a6d-d664a4604f52 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] validate_networks() for [('260cb37c-589d-4ef2-92eb-ce6dad8a9c4c', None, None, None, None, None)] {{(pid=123069) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 09:48:46.579510 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-b1af7782-c3da-48ee-a4ac-90fdbb8393a5 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.688986 Oct 28 09:48:46.585821 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 10/24] 10.222.0.104 () {60 vars in 1151 bytes} [Thu Oct 28 09:48:44 2021] POST /compute/v2.1/servers => generated 403 bytes in 1697 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 28 09:48:46.609152 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-54aa04f6-9821-4de7-b69f-065cc9d83975 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:46.610224 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-54aa04f6-9821-4de7-b69f-065cc9d83975 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:46.886723 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-54aa04f6-9821-4de7-b69f-065cc9d83975 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:46.908703 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-54aa04f6-9821-4de7-b69f-065cc9d83975 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1241 microversion: 2.1 time: 0.317664 Oct 28 09:48:46.921458 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 11/25] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:48:46 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1241 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:47.006158 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-864c95eb-ed4c-4150-b3a4-a20ce8c9d2ab tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:47.006158 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-864c95eb-ed4c-4150-b3a4-a20ce8c9d2ab tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:47.006158 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-864c95eb-ed4c-4150-b3a4-a20ce8c9d2ab tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:47.006158 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-864c95eb-ed4c-4150-b3a4-a20ce8c9d2ab tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:47.006866 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-864c95eb-ed4c-4150-b3a4-a20ce8c9d2ab tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:47.006866 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-864c95eb-ed4c-4150-b3a4-a20ce8c9d2ab tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:47.463854 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-864c95eb-ed4c-4150-b3a4-a20ce8c9d2ab tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb58dd8c77b4808b54874f4dac8501e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bfc73417aa4dacaee5ea501175efb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:47.474691 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-864c95eb-ed4c-4150-b3a4-a20ce8c9d2ab tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] 10.222.0.104 "GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b" status: 200 len: 1319 microversion: 2.1 time: 0.511694 Oct 28 09:48:47.481206 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 12/26] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:48:46 2021] GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b => generated 1319 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:47.648237 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-507f3bf9-3b80-4728-9a6d-d664a4604f52 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Flavor limits 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:48:47.648799 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-507f3bf9-3b80-4728-9a6d-d664a4604f52 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Image limits 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:48:47.649206 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-507f3bf9-3b80-4728-9a6d-d664a4604f52 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Flavor pref 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:48:47.649812 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-507f3bf9-3b80-4728-9a6d-d664a4604f52 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Image pref 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:48:47.650524 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-507f3bf9-3b80-4728-9a6d-d664a4604f52 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:48:47.665638 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-507f3bf9-3b80-4728-9a6d-d664a4604f52 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:47.666565 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-507f3bf9-3b80-4728-9a6d-d664a4604f52 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:47.667574 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-507f3bf9-3b80-4728-9a6d-d664a4604f52 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:47.668100 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-507f3bf9-3b80-4728-9a6d-d664a4604f52 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:47.695712 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.quota [None req-507f3bf9-3b80-4728-9a6d-d664a4604f52 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Getting quotas for project 137c34c5941c4c86801a0e6b8b5c2f67. Resources: {'ram', 'cores', 'instances'} {{(pid=123069) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 09:48:47.700836 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.quota [None req-507f3bf9-3b80-4728-9a6d-d664a4604f52 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Getting quotas for user 2dc1f105c9714526a2a0fb7b51d93102 and project 137c34c5941c4c86801a0e6b8b5c2f67. Resources: {'ram', 'cores', 'instances'} {{(pid=123069) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 09:48:47.714994 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-507f3bf9-3b80-4728-9a6d-d664a4604f52 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Going to run 1 instances... {{(pid=123069) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 09:48:47.718061 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-507f3bf9-3b80-4728-9a6d-d664a4604f52 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='623b30fc-1d92-46d9-b556-b9b963f3d76c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 09:48:47.938613 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-f32c607f-5c86-4dfc-8ce1-1b01b96d5489 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:47.939778 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-f32c607f-5c86-4dfc-8ce1-1b01b96d5489 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:47.967332 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-507f3bf9-3b80-4728-9a6d-d664a4604f52 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.20 time: 1.778914 Oct 28 09:48:47.968837 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 15/27] 10.222.0.104 () {62 vars in 1192 bytes} [Thu Oct 28 09:48:46 2021] POST /compute/v2.1/servers => generated 404 bytes in 1781 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 28 09:48:47.982109 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-52941fbd-216d-4b43-b3f7-29d7c8c3dc93 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:47.983251 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-52941fbd-216d-4b43-b3f7-29d7c8c3dc93 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:48.020292 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-f32c607f-5c86-4dfc-8ce1-1b01b96d5489 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:48.028962 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-f32c607f-5c86-4dfc-8ce1-1b01b96d5489 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1241 microversion: 2.1 time: 0.094487 Oct 28 09:48:48.032801 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 13/28] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:48:47 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1241 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:48.051667 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-52941fbd-216d-4b43-b3f7-29d7c8c3dc93 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:48.061584 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-52941fbd-216d-4b43-b3f7-29d7c8c3dc93 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:48.063910 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-52941fbd-216d-4b43-b3f7-29d7c8c3dc93 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:48.065252 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-52941fbd-216d-4b43-b3f7-29d7c8c3dc93 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1286 microversion: 2.20 time: 0.089949 Oct 28 09:48:48.066376 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 16/29] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:48:47 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:48:48.492152 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-688d6a0a-65a4-4d94-8158-46652ee2c3b1 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:48.492867 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-688d6a0a-65a4-4d94-8158-46652ee2c3b1 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:48.506370 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-688d6a0a-65a4-4d94-8158-46652ee2c3b1 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:48.507286 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-688d6a0a-65a4-4d94-8158-46652ee2c3b1 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:48.508815 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-688d6a0a-65a4-4d94-8158-46652ee2c3b1 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:48.509390 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-688d6a0a-65a4-4d94-8158-46652ee2c3b1 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:48.788727 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-688d6a0a-65a4-4d94-8158-46652ee2c3b1 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb58dd8c77b4808b54874f4dac8501e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bfc73417aa4dacaee5ea501175efb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:48.802452 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-688d6a0a-65a4-4d94-8158-46652ee2c3b1 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] 10.222.0.104 "GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b" status: 200 len: 1319 microversion: 2.1 time: 0.314065 Oct 28 09:48:48.817106 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 14/30] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:48:48 2021] GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b => generated 1319 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:49.049527 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-202730ce-a893-4050-a768-1c42e2f2456d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:49.050089 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-202730ce-a893-4050-a768-1c42e2f2456d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:49.085160 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-5ebab117-cb27-4ca0-acc4-974fd13fda38 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:49.086225 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-5ebab117-cb27-4ca0-acc4-974fd13fda38 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:49.350752 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-202730ce-a893-4050-a768-1c42e2f2456d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:49.370366 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-202730ce-a893-4050-a768-1c42e2f2456d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1241 microversion: 2.1 time: 0.324492 Oct 28 09:48:49.375363 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 17/31] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:48:49 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1241 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:49.395443 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-5ebab117-cb27-4ca0-acc4-974fd13fda38 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:49.408101 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-5ebab117-cb27-4ca0-acc4-974fd13fda38 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:49.410769 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-5ebab117-cb27-4ca0-acc4-974fd13fda38 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:49.417493 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-5ebab117-cb27-4ca0-acc4-974fd13fda38 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1286 microversion: 2.20 time: 0.335996 Oct 28 09:48:49.418718 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 15/32] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:48:49 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1286 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:48:49.835855 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-cbfddadf-1dc9-4821-8107-fffea474959d tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:49.835855 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-cbfddadf-1dc9-4821-8107-fffea474959d tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:49.835855 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-cbfddadf-1dc9-4821-8107-fffea474959d tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:49.835855 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-cbfddadf-1dc9-4821-8107-fffea474959d tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:49.836326 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-cbfddadf-1dc9-4821-8107-fffea474959d tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:49.836326 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-cbfddadf-1dc9-4821-8107-fffea474959d tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:50.010877 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-cbfddadf-1dc9-4821-8107-fffea474959d tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb58dd8c77b4808b54874f4dac8501e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bfc73417aa4dacaee5ea501175efb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:50.035466 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-cbfddadf-1dc9-4821-8107-fffea474959d tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] 10.222.0.104 "GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b" status: 200 len: 1319 microversion: 2.1 time: 0.217855 Oct 28 09:48:50.037049 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 18/33] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:48:49 2021] GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:50.556564 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-8725554b-554c-4bb7-80bb-28630c8de030 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:50.556564 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-8725554b-554c-4bb7-80bb-28630c8de030 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:50.558026 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-97731715-0a2c-4f35-849b-1ba0cfbc529f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:50.558026 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-97731715-0a2c-4f35-849b-1ba0cfbc529f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:50.558482 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-8725554b-554c-4bb7-80bb-28630c8de030 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:50.558482 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-8725554b-554c-4bb7-80bb-28630c8de030 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1241 microversion: 2.1 time: 0.068622 Oct 28 09:48:50.558482 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 16/34] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:48:50 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:50.558734 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-97731715-0a2c-4f35-849b-1ba0cfbc529f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:50.558734 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-97731715-0a2c-4f35-849b-1ba0cfbc529f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:50.558909 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-97731715-0a2c-4f35-849b-1ba0cfbc529f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:50.558909 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-97731715-0a2c-4f35-849b-1ba0cfbc529f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1286 microversion: 2.20 time: 0.073444 Oct 28 09:48:50.558909 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 19/35] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:48:50 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:48:51.059225 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-cca0034a-2af1-4cdc-844e-f8153599b894 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:51.060438 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-cca0034a-2af1-4cdc-844e-f8153599b894 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:51.070775 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cca0034a-2af1-4cdc-844e-f8153599b894 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:51.071460 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cca0034a-2af1-4cdc-844e-f8153599b894 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:51.083887 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cca0034a-2af1-4cdc-844e-f8153599b894 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:51.084736 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cca0034a-2af1-4cdc-844e-f8153599b894 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:51.268014 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-cca0034a-2af1-4cdc-844e-f8153599b894 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb58dd8c77b4808b54874f4dac8501e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bfc73417aa4dacaee5ea501175efb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:51.276159 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-cca0034a-2af1-4cdc-844e-f8153599b894 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] 10.222.0.104 "GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b" status: 200 len: 1319 microversion: 2.1 time: 0.223714 Oct 28 09:48:51.287201 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 17/36] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:48:51 2021] GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:51.569125 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-18bf5f82-7c5f-45bd-a0de-f6d80a9fc17a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:51.569125 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-18bf5f82-7c5f-45bd-a0de-f6d80a9fc17a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:51.571102 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-941c8ec3-05ab-4646-a059-1cd23a479513 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:51.571787 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-941c8ec3-05ab-4646-a059-1cd23a479513 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:51.573120 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-18bf5f82-7c5f-45bd-a0de-f6d80a9fc17a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:51.573676 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-18bf5f82-7c5f-45bd-a0de-f6d80a9fc17a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:51.574728 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-18bf5f82-7c5f-45bd-a0de-f6d80a9fc17a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:51.575267 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-18bf5f82-7c5f-45bd-a0de-f6d80a9fc17a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:51.579754 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-941c8ec3-05ab-4646-a059-1cd23a479513 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:51.580204 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-941c8ec3-05ab-4646-a059-1cd23a479513 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:51.582393 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-941c8ec3-05ab-4646-a059-1cd23a479513 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:51.598006 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-941c8ec3-05ab-4646-a059-1cd23a479513 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:51.694125 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-18bf5f82-7c5f-45bd-a0de-f6d80a9fc17a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:51.702699 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-18bf5f82-7c5f-45bd-a0de-f6d80a9fc17a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:51.704369 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-18bf5f82-7c5f-45bd-a0de-f6d80a9fc17a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:51.705769 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-18bf5f82-7c5f-45bd-a0de-f6d80a9fc17a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1290 microversion: 2.20 time: 0.145497 Oct 28 09:48:51.712731 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 18/37] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:48:51 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1290 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:48:51.726149 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-941c8ec3-05ab-4646-a059-1cd23a479513 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:51.746076 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-941c8ec3-05ab-4646-a059-1cd23a479513 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1245 microversion: 2.1 time: 0.185016 Oct 28 09:48:51.747925 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 20/38] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:48:51 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1245 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:52.293894 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-d29bc27a-4a53-4884-a443-6dd7c46eed12 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:52.295039 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-d29bc27a-4a53-4884-a443-6dd7c46eed12 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:52.301586 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d29bc27a-4a53-4884-a443-6dd7c46eed12 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:52.302028 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d29bc27a-4a53-4884-a443-6dd7c46eed12 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:52.302998 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d29bc27a-4a53-4884-a443-6dd7c46eed12 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:52.303558 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d29bc27a-4a53-4884-a443-6dd7c46eed12 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:52.489805 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-d29bc27a-4a53-4884-a443-6dd7c46eed12 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb58dd8c77b4808b54874f4dac8501e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bfc73417aa4dacaee5ea501175efb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:52.499862 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-d29bc27a-4a53-4884-a443-6dd7c46eed12 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] 10.222.0.104 "GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b" status: 200 len: 1319 microversion: 2.1 time: 0.210016 Oct 28 09:48:52.508590 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 19/39] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:48:52 2021] GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:52.725251 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-b873d62b-87bf-428f-84d7-184626060b08 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:52.726422 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-b873d62b-87bf-428f-84d7-184626060b08 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:52.733453 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b873d62b-87bf-428f-84d7-184626060b08 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:52.733785 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b873d62b-87bf-428f-84d7-184626060b08 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:52.734699 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b873d62b-87bf-428f-84d7-184626060b08 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:52.735135 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b873d62b-87bf-428f-84d7-184626060b08 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:52.764803 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-7a237661-96da-4b62-874d-e514c7b1718d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:52.766502 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-7a237661-96da-4b62-874d-e514c7b1718d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:52.773466 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7a237661-96da-4b62-874d-e514c7b1718d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:52.777480 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7a237661-96da-4b62-874d-e514c7b1718d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:52.777480 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7a237661-96da-4b62-874d-e514c7b1718d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:52.777480 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7a237661-96da-4b62-874d-e514c7b1718d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:52.823092 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-b873d62b-87bf-428f-84d7-184626060b08 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:52.835667 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-b873d62b-87bf-428f-84d7-184626060b08 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:52.838068 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-b873d62b-87bf-428f-84d7-184626060b08 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:52.839154 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-b873d62b-87bf-428f-84d7-184626060b08 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1290 microversion: 2.20 time: 0.117840 Oct 28 09:48:52.850094 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 21/40] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:48:52 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1290 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:48:52.854718 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-7a237661-96da-4b62-874d-e514c7b1718d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:52.862651 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-7a237661-96da-4b62-874d-e514c7b1718d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1245 microversion: 2.1 time: 0.103041 Oct 28 09:48:52.863275 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 20/41] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:48:52 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1245 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:53.521610 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-74f8c380-ff1d-4eb6-8dfb-3a550790e33b tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:53.522498 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-74f8c380-ff1d-4eb6-8dfb-3a550790e33b tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:53.533616 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-74f8c380-ff1d-4eb6-8dfb-3a550790e33b tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:53.534875 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-74f8c380-ff1d-4eb6-8dfb-3a550790e33b tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:53.537057 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-74f8c380-ff1d-4eb6-8dfb-3a550790e33b tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:53.539132 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-74f8c380-ff1d-4eb6-8dfb-3a550790e33b tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:53.736983 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-74f8c380-ff1d-4eb6-8dfb-3a550790e33b tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb58dd8c77b4808b54874f4dac8501e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bfc73417aa4dacaee5ea501175efb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:53.747427 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-74f8c380-ff1d-4eb6-8dfb-3a550790e33b tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] 10.222.0.104 "GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b" status: 200 len: 1319 microversion: 2.1 time: 0.229494 Oct 28 09:48:53.758813 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 22/42] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:48:53 2021] GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:53.858009 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-46919ed0-c02f-4348-be60-b839b7f1236b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:53.859132 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-46919ed0-c02f-4348-be60-b839b7f1236b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:53.865308 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-46919ed0-c02f-4348-be60-b839b7f1236b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:53.865891 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-46919ed0-c02f-4348-be60-b839b7f1236b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:53.866672 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-46919ed0-c02f-4348-be60-b839b7f1236b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:53.867110 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-46919ed0-c02f-4348-be60-b839b7f1236b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:53.879574 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-05abcf35-b5ae-4e6c-ab10-dd18ee72a565 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:53.880293 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-05abcf35-b5ae-4e6c-ab10-dd18ee72a565 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:53.887403 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-05abcf35-b5ae-4e6c-ab10-dd18ee72a565 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:53.887846 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-05abcf35-b5ae-4e6c-ab10-dd18ee72a565 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:53.888642 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-05abcf35-b5ae-4e6c-ab10-dd18ee72a565 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:53.889093 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-05abcf35-b5ae-4e6c-ab10-dd18ee72a565 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:53.959956 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-46919ed0-c02f-4348-be60-b839b7f1236b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:53.974105 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-46919ed0-c02f-4348-be60-b839b7f1236b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:53.975758 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-46919ed0-c02f-4348-be60-b839b7f1236b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:53.978951 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-46919ed0-c02f-4348-be60-b839b7f1236b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1282 microversion: 2.20 time: 0.125286 Oct 28 09:48:53.979821 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 21/43] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:48:53 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1282 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:48:53.991498 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-05abcf35-b5ae-4e6c-ab10-dd18ee72a565 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:53.999488 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-05abcf35-b5ae-4e6c-ab10-dd18ee72a565 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1237 microversion: 2.1 time: 0.123732 Oct 28 09:48:54.000087 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 23/44] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:48:53 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1237 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:54.768422 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-b85472ef-08ee-41d2-925b-a7e1a5e750e9 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:54.769237 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-b85472ef-08ee-41d2-925b-a7e1a5e750e9 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:54.777202 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b85472ef-08ee-41d2-925b-a7e1a5e750e9 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:54.777649 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b85472ef-08ee-41d2-925b-a7e1a5e750e9 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:54.778459 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b85472ef-08ee-41d2-925b-a7e1a5e750e9 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:54.779063 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b85472ef-08ee-41d2-925b-a7e1a5e750e9 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:54.913656 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-b85472ef-08ee-41d2-925b-a7e1a5e750e9 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb58dd8c77b4808b54874f4dac8501e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bfc73417aa4dacaee5ea501175efb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:54.931215 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-b85472ef-08ee-41d2-925b-a7e1a5e750e9 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] 10.222.0.104 "GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b" status: 200 len: 1319 microversion: 2.1 time: 0.160229 Oct 28 09:48:54.931215 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 22/45] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:48:54 2021] GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:55.000003 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-aa3e2ee6-0a2e-4645-b769-2ddaaf48dfb7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:55.001297 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-aa3e2ee6-0a2e-4645-b769-2ddaaf48dfb7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:55.007428 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-aa3e2ee6-0a2e-4645-b769-2ddaaf48dfb7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:55.007876 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-aa3e2ee6-0a2e-4645-b769-2ddaaf48dfb7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:55.008696 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-aa3e2ee6-0a2e-4645-b769-2ddaaf48dfb7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:55.009133 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-aa3e2ee6-0a2e-4645-b769-2ddaaf48dfb7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:55.017167 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-a29798d7-196c-4118-a49e-ad2100d36f9e tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:55.017890 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-a29798d7-196c-4118-a49e-ad2100d36f9e tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:55.023860 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a29798d7-196c-4118-a49e-ad2100d36f9e tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:55.024435 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a29798d7-196c-4118-a49e-ad2100d36f9e tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:55.025248 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a29798d7-196c-4118-a49e-ad2100d36f9e tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:55.025676 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a29798d7-196c-4118-a49e-ad2100d36f9e tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:55.075193 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-aa3e2ee6-0a2e-4645-b769-2ddaaf48dfb7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:55.084019 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-aa3e2ee6-0a2e-4645-b769-2ddaaf48dfb7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:55.085717 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-aa3e2ee6-0a2e-4645-b769-2ddaaf48dfb7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:55.095093 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-aa3e2ee6-0a2e-4645-b769-2ddaaf48dfb7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1282 microversion: 2.20 time: 0.091585 Oct 28 09:48:55.095093 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 24/46] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:48:54 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1282 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:48:55.099815 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-a29798d7-196c-4118-a49e-ad2100d36f9e tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:55.108960 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-a29798d7-196c-4118-a49e-ad2100d36f9e tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1293 microversion: 2.1 time: 0.095999 Oct 28 09:48:55.109541 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 23/47] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:48:55 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1293 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:48:55.940053 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-adc394de-368d-4053-afb5-e8eb02c99e95 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:55.940710 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-adc394de-368d-4053-afb5-e8eb02c99e95 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:55.946612 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-adc394de-368d-4053-afb5-e8eb02c99e95 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:55.947051 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-adc394de-368d-4053-afb5-e8eb02c99e95 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:55.947814 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-adc394de-368d-4053-afb5-e8eb02c99e95 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:55.948327 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-adc394de-368d-4053-afb5-e8eb02c99e95 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:56.081379 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-adc394de-368d-4053-afb5-e8eb02c99e95 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb58dd8c77b4808b54874f4dac8501e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bfc73417aa4dacaee5ea501175efb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:56.088642 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-adc394de-368d-4053-afb5-e8eb02c99e95 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] 10.222.0.104 "GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b" status: 200 len: 1319 microversion: 2.1 time: 0.152230 Oct 28 09:48:56.089222 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 25/48] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:48:55 2021] GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:56.111126 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-21151ce1-2d3c-4cbd-ad43-48f14db00a67 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:56.111126 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-21151ce1-2d3c-4cbd-ad43-48f14db00a67 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:56.114648 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-21151ce1-2d3c-4cbd-ad43-48f14db00a67 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:56.115131 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-21151ce1-2d3c-4cbd-ad43-48f14db00a67 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:56.115913 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-21151ce1-2d3c-4cbd-ad43-48f14db00a67 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:56.116342 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-21151ce1-2d3c-4cbd-ad43-48f14db00a67 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:56.126564 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-9a323eae-41e2-4185-8d20-0d30241cd4f0 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:56.127184 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-9a323eae-41e2-4185-8d20-0d30241cd4f0 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:56.147027 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9a323eae-41e2-4185-8d20-0d30241cd4f0 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:56.147642 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9a323eae-41e2-4185-8d20-0d30241cd4f0 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:56.148585 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9a323eae-41e2-4185-8d20-0d30241cd4f0 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:56.149053 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9a323eae-41e2-4185-8d20-0d30241cd4f0 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:56.188110 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-21151ce1-2d3c-4cbd-ad43-48f14db00a67 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:56.197463 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-21151ce1-2d3c-4cbd-ad43-48f14db00a67 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:56.198982 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-21151ce1-2d3c-4cbd-ad43-48f14db00a67 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:56.200275 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-21151ce1-2d3c-4cbd-ad43-48f14db00a67 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1282 microversion: 2.20 time: 0.098801 Oct 28 09:48:56.201119 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 24/49] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:48:56 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1282 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:48:56.220292 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-9a323eae-41e2-4185-8d20-0d30241cd4f0 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:56.228339 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-9a323eae-41e2-4185-8d20-0d30241cd4f0 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1293 microversion: 2.1 time: 0.105788 Oct 28 09:48:56.228984 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 26/50] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:48:56 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1293 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:57.107202 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-dcf00f55-c90f-4c20-acc6-fe4505e6517d tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:57.107881 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-dcf00f55-c90f-4c20-acc6-fe4505e6517d tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:57.114295 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-dcf00f55-c90f-4c20-acc6-fe4505e6517d tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:57.115055 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-dcf00f55-c90f-4c20-acc6-fe4505e6517d tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:57.115661 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-dcf00f55-c90f-4c20-acc6-fe4505e6517d tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:57.116111 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-dcf00f55-c90f-4c20-acc6-fe4505e6517d tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:57.220508 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-0fa883bf-a712-4e9d-9213-97ce77bdc1f6 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:57.222073 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-0fa883bf-a712-4e9d-9213-97ce77bdc1f6 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:57.228258 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0fa883bf-a712-4e9d-9213-97ce77bdc1f6 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:57.229237 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0fa883bf-a712-4e9d-9213-97ce77bdc1f6 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:57.230279 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0fa883bf-a712-4e9d-9213-97ce77bdc1f6 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:57.231213 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0fa883bf-a712-4e9d-9213-97ce77bdc1f6 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:57.259124 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-dcf00f55-c90f-4c20-acc6-fe4505e6517d tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb58dd8c77b4808b54874f4dac8501e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bfc73417aa4dacaee5ea501175efb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:57.267468 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-dcf00f55-c90f-4c20-acc6-fe4505e6517d tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] 10.222.0.104 "GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b" status: 200 len: 1319 microversion: 2.1 time: 0.164250 Oct 28 09:48:57.268055 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 25/51] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:48:57 2021] GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:57.272645 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-e132e344-ce78-489f-b989-4af0aed0ea43 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:57.273403 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-e132e344-ce78-489f-b989-4af0aed0ea43 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:57.280217 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e132e344-ce78-489f-b989-4af0aed0ea43 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:57.280695 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e132e344-ce78-489f-b989-4af0aed0ea43 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:57.281487 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e132e344-ce78-489f-b989-4af0aed0ea43 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:57.281934 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e132e344-ce78-489f-b989-4af0aed0ea43 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:57.301323 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-0fa883bf-a712-4e9d-9213-97ce77bdc1f6 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:57.310182 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-0fa883bf-a712-4e9d-9213-97ce77bdc1f6 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:57.312345 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-0fa883bf-a712-4e9d-9213-97ce77bdc1f6 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:57.313469 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-0fa883bf-a712-4e9d-9213-97ce77bdc1f6 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1282 microversion: 2.20 time: 0.098401 Oct 28 09:48:57.314231 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 27/52] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:48:57 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1282 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:48:57.346516 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-e132e344-ce78-489f-b989-4af0aed0ea43 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:57.356329 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-e132e344-ce78-489f-b989-4af0aed0ea43 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1293 microversion: 2.1 time: 0.086756 Oct 28 09:48:57.357272 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 26/53] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:48:57 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:58.285693 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-bf187074-f6eb-4bd4-a0a1-073117eba805 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:58.286386 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-bf187074-f6eb-4bd4-a0a1-073117eba805 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:58.294273 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bf187074-f6eb-4bd4-a0a1-073117eba805 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:58.295778 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bf187074-f6eb-4bd4-a0a1-073117eba805 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:58.296832 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bf187074-f6eb-4bd4-a0a1-073117eba805 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:58.297522 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bf187074-f6eb-4bd4-a0a1-073117eba805 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:58.331217 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-2034bb68-5dc3-45a7-b4e4-f682a0826e3f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:58.331946 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-2034bb68-5dc3-45a7-b4e4-f682a0826e3f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:58.340515 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2034bb68-5dc3-45a7-b4e4-f682a0826e3f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:58.345312 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2034bb68-5dc3-45a7-b4e4-f682a0826e3f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:58.346396 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2034bb68-5dc3-45a7-b4e4-f682a0826e3f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:58.347236 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2034bb68-5dc3-45a7-b4e4-f682a0826e3f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:58.463699 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-2034bb68-5dc3-45a7-b4e4-f682a0826e3f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:58.474513 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-2034bb68-5dc3-45a7-b4e4-f682a0826e3f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:58.487649 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-2034bb68-5dc3-45a7-b4e4-f682a0826e3f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:58.488788 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-2034bb68-5dc3-45a7-b4e4-f682a0826e3f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1346 microversion: 2.20 time: 0.161137 Oct 28 09:48:58.489366 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 27/54] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:48:58 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1346 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:48:58.503624 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-b08a6abe-4931-4561-9291-af399029dc0c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:58.514763 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-b08a6abe-4931-4561-9291-af399029dc0c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:58.517369 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b08a6abe-4931-4561-9291-af399029dc0c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:58.518001 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b08a6abe-4931-4561-9291-af399029dc0c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:58.518950 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b08a6abe-4931-4561-9291-af399029dc0c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:58.519558 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b08a6abe-4931-4561-9291-af399029dc0c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:58.730568 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-bf187074-f6eb-4bd4-a0a1-073117eba805 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb58dd8c77b4808b54874f4dac8501e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bfc73417aa4dacaee5ea501175efb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:58.740532 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-bf187074-f6eb-4bd4-a0a1-073117eba805 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] 10.222.0.104 "GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b" status: 200 len: 1319 microversion: 2.1 time: 0.458887 Oct 28 09:48:58.755956 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 28/55] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:48:58 2021] GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b => generated 1319 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:58.881290 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-b08a6abe-4931-4561-9291-af399029dc0c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:58.891835 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-b08a6abe-4931-4561-9291-af399029dc0c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1366 microversion: 2.1 time: 0.396078 Oct 28 09:48:58.892401 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 28/56] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:48:58 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1366 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:59.509405 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-6d9f9bb0-03ce-494a-b835-23c5a14f4d4f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:59.511419 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-6d9f9bb0-03ce-494a-b835-23c5a14f4d4f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:59.521945 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6d9f9bb0-03ce-494a-b835-23c5a14f4d4f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:59.521945 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6d9f9bb0-03ce-494a-b835-23c5a14f4d4f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:59.523841 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6d9f9bb0-03ce-494a-b835-23c5a14f4d4f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:59.524602 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6d9f9bb0-03ce-494a-b835-23c5a14f4d4f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:59.675200 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-6d9f9bb0-03ce-494a-b835-23c5a14f4d4f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:59.705174 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-6d9f9bb0-03ce-494a-b835-23c5a14f4d4f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:59.714194 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-6d9f9bb0-03ce-494a-b835-23c5a14f4d4f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:59.715524 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-6d9f9bb0-03ce-494a-b835-23c5a14f4d4f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1344 microversion: 2.20 time: 0.211579 Oct 28 09:48:59.717159 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 29/57] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:48:59 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1344 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:48:59.757977 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-779f3729-ae74-4a04-86af-ab0cf2cabb5b tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:59.759353 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-779f3729-ae74-4a04-86af-ab0cf2cabb5b tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:59.769775 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-779f3729-ae74-4a04-86af-ab0cf2cabb5b tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:59.770492 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-779f3729-ae74-4a04-86af-ab0cf2cabb5b tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:59.772940 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-779f3729-ae74-4a04-86af-ab0cf2cabb5b tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:59.774071 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-779f3729-ae74-4a04-86af-ab0cf2cabb5b tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:59.910289 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-3bb530db-5ebf-4c18-b57e-cf0a463bbe08 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:59.910862 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-3bb530db-5ebf-4c18-b57e-cf0a463bbe08 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:48:59.915721 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-779f3729-ae74-4a04-86af-ab0cf2cabb5b tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb58dd8c77b4808b54874f4dac8501e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bfc73417aa4dacaee5ea501175efb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:48:59.918685 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3bb530db-5ebf-4c18-b57e-cf0a463bbe08 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:59.919125 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3bb530db-5ebf-4c18-b57e-cf0a463bbe08 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:59.920570 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3bb530db-5ebf-4c18-b57e-cf0a463bbe08 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:48:59.921338 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3bb530db-5ebf-4c18-b57e-cf0a463bbe08 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:48:59.924350 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-779f3729-ae74-4a04-86af-ab0cf2cabb5b tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] 10.222.0.104 "GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b" status: 200 len: 1319 microversion: 2.1 time: 0.170380 Oct 28 09:48:59.925285 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 29/58] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:48:59 2021] GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:00.063640 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-3bb530db-5ebf-4c18-b57e-cf0a463bbe08 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:00.085167 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-3bb530db-5ebf-4c18-b57e-cf0a463bbe08 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1366 microversion: 2.1 time: 0.179019 Oct 28 09:49:00.085756 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 30/59] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:48:59 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:49:00.273685 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-4160893c-f329-4fb5-8910-a496e1d4799d req-a02039f4-96a0-4f75-8c49-a26d121e639e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a4e433d-b808-4128-9e1e-cd8f5f7e20f4", "tag": "a76427d7-3f5c-4e87-ab53-ee0815c5d946"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:00.277960 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:49:00.277960 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:49:00.325221 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-4160893c-f329-4fb5-8910-a496e1d4799d req-a02039f4-96a0-4f75-8c49-a26d121e639e service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:00.326215 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-4160893c-f329-4fb5-8910-a496e1d4799d req-a02039f4-96a0-4f75-8c49-a26d121e639e service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:00.354229 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-4160893c-f329-4fb5-8910-a496e1d4799d req-a02039f4-96a0-4f75-8c49-a26d121e639e service nova] Creating event network-changed:a76427d7-3f5c-4e87-ab53-ee0815c5d946 for instance 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 on hv-cinder-81571 Oct 28 09:49:00.354892 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-4160893c-f329-4fb5-8910-a496e1d4799d req-a02039f4-96a0-4f75-8c49-a26d121e639e service nova] Acquired lock "compute-rpcapi-router" {{(pid=123068) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Oct 28 09:49:00.356012 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c3892920-aba0-4d8a-a5bd-fec94d6a8e3d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:00.356446 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c3892920-aba0-4d8a-a5bd-fec94d6a8e3d None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:00.357501 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c3892920-aba0-4d8a-a5bd-fec94d6a8e3d None None] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:00.357925 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c3892920-aba0-4d8a-a5bd-fec94d6a8e3d None None] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:00.367564 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.compute.rpcapi [None req-c3892920-aba0-4d8a-a5bd-fec94d6a8e3d None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Oct 28 09:49:00.368457 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c3892920-aba0-4d8a-a5bd-fec94d6a8e3d None None] Releasing lock "compute-rpcapi-router" {{(pid=123068) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Oct 28 09:49:00.396846 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-c3892920-aba0-4d8a-a5bd-fec94d6a8e3d None None] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128914 Oct 28 09:49:00.401362 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 30/60] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:49:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:49:00.737959 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-4cb41cb9-23fa-429b-b7dd-9a56143157ae tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:00.743810 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-4cb41cb9-23fa-429b-b7dd-9a56143157ae tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:00.747767 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4cb41cb9-23fa-429b-b7dd-9a56143157ae tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:00.748382 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4cb41cb9-23fa-429b-b7dd-9a56143157ae tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:00.749528 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4cb41cb9-23fa-429b-b7dd-9a56143157ae tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:00.750935 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4cb41cb9-23fa-429b-b7dd-9a56143157ae tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:00.945686 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-bd233883-c3f9-4290-9484-e790f2a04d7a tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:00.947477 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-bd233883-c3f9-4290-9484-e790f2a04d7a tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:00.979604 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bd233883-c3f9-4290-9484-e790f2a04d7a tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:00.982203 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bd233883-c3f9-4290-9484-e790f2a04d7a tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:00.987842 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bd233883-c3f9-4290-9484-e790f2a04d7a tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:00.991049 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bd233883-c3f9-4290-9484-e790f2a04d7a tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:01.372322 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-bd233883-c3f9-4290-9484-e790f2a04d7a tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb58dd8c77b4808b54874f4dac8501e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bfc73417aa4dacaee5ea501175efb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:01.378036 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-4cb41cb9-23fa-429b-b7dd-9a56143157ae tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:01.388052 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-4cb41cb9-23fa-429b-b7dd-9a56143157ae tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:01.394482 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-4cb41cb9-23fa-429b-b7dd-9a56143157ae tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:01.398269 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-4cb41cb9-23fa-429b-b7dd-9a56143157ae tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1412 microversion: 2.20 time: 0.666932 Oct 28 09:49:01.408886 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-bd233883-c3f9-4290-9484-e790f2a04d7a tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] 10.222.0.104 "GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b" status: 200 len: 1319 microversion: 2.1 time: 0.467115 Oct 28 09:49:01.412904 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 31/61] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:49:00 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1412 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:01.417976 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 31/62] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:49:00 2021] GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b => generated 1319 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:49:01.430581 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-92c8f1bc-02ee-4dc6-a198-b928f47114b8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:01.431362 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-92c8f1bc-02ee-4dc6-a198-b928f47114b8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:01.444445 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-92c8f1bc-02ee-4dc6-a198-b928f47114b8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:01.444877 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-92c8f1bc-02ee-4dc6-a198-b928f47114b8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:01.446005 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-92c8f1bc-02ee-4dc6-a198-b928f47114b8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:01.446357 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-92c8f1bc-02ee-4dc6-a198-b928f47114b8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:01.633036 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-92c8f1bc-02ee-4dc6-a198-b928f47114b8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:01.643377 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-92c8f1bc-02ee-4dc6-a198-b928f47114b8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1366 microversion: 2.1 time: 0.229115 Oct 28 09:49:01.650320 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 32/63] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:49:01 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:02.419657 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-943a4daa-c82f-4557-a4eb-13736a4263e8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:02.429913 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-943a4daa-c82f-4557-a4eb-13736a4263e8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:02.435060 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-943a4daa-c82f-4557-a4eb-13736a4263e8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:02.435859 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-943a4daa-c82f-4557-a4eb-13736a4263e8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:02.436677 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-943a4daa-c82f-4557-a4eb-13736a4263e8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:02.437264 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-943a4daa-c82f-4557-a4eb-13736a4263e8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:02.734185 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-235fc186-e791-41b6-83f6-cb7e207fe37d req-07c9363d-b078-4344-90fa-d6ecfeb50423 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5350c012-82d4-49d1-8b70-4eb8fb4d242b", "name": "network-vif-plugged", "status": "completed", "tag": "5874a229-cd52-4a12-9711-544832ced32e"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:02.737383 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:49:02.737383 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:49:02.745931 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-235fc186-e791-41b6-83f6-cb7e207fe37d req-07c9363d-b078-4344-90fa-d6ecfeb50423 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:02.751873 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-235fc186-e791-41b6-83f6-cb7e207fe37d req-07c9363d-b078-4344-90fa-d6ecfeb50423 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:02.761237 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-235fc186-e791-41b6-83f6-cb7e207fe37d req-07c9363d-b078-4344-90fa-d6ecfeb50423 service nova] Creating event network-vif-plugged:5874a229-cd52-4a12-9711-544832ced32e for instance 5350c012-82d4-49d1-8b70-4eb8fb4d242b on hv-cinder-81571 Oct 28 09:49:02.767920 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-235fc186-e791-41b6-83f6-cb7e207fe37d req-07c9363d-b078-4344-90fa-d6ecfeb50423 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.356486 Oct 28 09:49:02.769064 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 32/64] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:49:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:49:02.775286 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-d57362d7-7030-4eb8-8d3a-7b4607ec1098 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:02.776228 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-d57362d7-7030-4eb8-8d3a-7b4607ec1098 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:02.783457 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d57362d7-7030-4eb8-8d3a-7b4607ec1098 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:02.784128 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d57362d7-7030-4eb8-8d3a-7b4607ec1098 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:02.789091 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d57362d7-7030-4eb8-8d3a-7b4607ec1098 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:02.789091 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d57362d7-7030-4eb8-8d3a-7b4607ec1098 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:02.943476 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-943a4daa-c82f-4557-a4eb-13736a4263e8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:02.954005 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-943a4daa-c82f-4557-a4eb-13736a4263e8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:02.960548 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-943a4daa-c82f-4557-a4eb-13736a4263e8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:02.962310 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-943a4daa-c82f-4557-a4eb-13736a4263e8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1412 microversion: 2.20 time: 0.546441 Oct 28 09:49:02.963304 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 33/65] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:49:02 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1412 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:49:02.975468 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-774fc66f-9579-4521-9600-e25afa80b6c2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:02.976586 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-774fc66f-9579-4521-9600-e25afa80b6c2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:02.985561 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-774fc66f-9579-4521-9600-e25afa80b6c2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:02.986889 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-774fc66f-9579-4521-9600-e25afa80b6c2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:02.988283 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-774fc66f-9579-4521-9600-e25afa80b6c2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:02.989222 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-774fc66f-9579-4521-9600-e25afa80b6c2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:03.146703 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-d57362d7-7030-4eb8-8d3a-7b4607ec1098 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb58dd8c77b4808b54874f4dac8501e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bfc73417aa4dacaee5ea501175efb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:03.155385 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-d57362d7-7030-4eb8-8d3a-7b4607ec1098 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] 10.222.0.104 "GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b" status: 200 len: 1319 microversion: 2.1 time: 0.384928 Oct 28 09:49:03.155974 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 33/66] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:49:02 2021] GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b => generated 1319 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:03.302523 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-774fc66f-9579-4521-9600-e25afa80b6c2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:03.313330 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-774fc66f-9579-4521-9600-e25afa80b6c2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1366 microversion: 2.1 time: 0.347947 Oct 28 09:49:03.313956 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 34/67] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:49:02 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1366 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:03.374718 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-e24f4d0e-e3df-4025-b552-3b7b78217eb9 req-79a489c7-b3d9-4ebd-8ad4-2acee5d5b003 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b49b31e1-36d8-4096-a5fc-b2d46ef922eb", "tag": "b51e7b00-09ad-41ca-b851-00805473b75a"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:03.377288 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:49:03.377288 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:49:03.386298 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-e24f4d0e-e3df-4025-b552-3b7b78217eb9 req-79a489c7-b3d9-4ebd-8ad4-2acee5d5b003 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:03.386736 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-e24f4d0e-e3df-4025-b552-3b7b78217eb9 req-79a489c7-b3d9-4ebd-8ad4-2acee5d5b003 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:03.400468 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-e24f4d0e-e3df-4025-b552-3b7b78217eb9 req-79a489c7-b3d9-4ebd-8ad4-2acee5d5b003 service nova] Creating event network-changed:b51e7b00-09ad-41ca-b851-00805473b75a for instance b49b31e1-36d8-4096-a5fc-b2d46ef922eb on hv-cinder-81571 Oct 28 09:49:03.406726 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-e24f4d0e-e3df-4025-b552-3b7b78217eb9 req-79a489c7-b3d9-4ebd-8ad4-2acee5d5b003 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.248875 Oct 28 09:49:03.410368 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 34/68] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:49:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:49:03.982159 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-6ef29be3-e134-4e56-a4fe-1fe78f98669c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:03.982977 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-6ef29be3-e134-4e56-a4fe-1fe78f98669c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:03.991635 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6ef29be3-e134-4e56-a4fe-1fe78f98669c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:03.996237 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6ef29be3-e134-4e56-a4fe-1fe78f98669c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:03.996237 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6ef29be3-e134-4e56-a4fe-1fe78f98669c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:03.996237 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6ef29be3-e134-4e56-a4fe-1fe78f98669c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:04.175161 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-84d7d896-fc48-4edc-a521-173ff0925690 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:04.176093 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-84d7d896-fc48-4edc-a521-173ff0925690 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:04.183521 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-84d7d896-fc48-4edc-a521-173ff0925690 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:04.185374 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-84d7d896-fc48-4edc-a521-173ff0925690 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:04.190263 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-84d7d896-fc48-4edc-a521-173ff0925690 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:04.195781 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-84d7d896-fc48-4edc-a521-173ff0925690 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:04.483544 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-6ef29be3-e134-4e56-a4fe-1fe78f98669c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:04.491886 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-6ef29be3-e134-4e56-a4fe-1fe78f98669c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:04.493969 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-6ef29be3-e134-4e56-a4fe-1fe78f98669c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:04.495311 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-6ef29be3-e134-4e56-a4fe-1fe78f98669c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1412 microversion: 2.20 time: 0.516893 Oct 28 09:49:04.496190 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 35/69] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:49:03 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1412 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:04.502404 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-1b3139e0-d507-4fe5-9d20-4f983ffbeda2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:04.503247 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-1b3139e0-d507-4fe5-9d20-4f983ffbeda2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:04.510031 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1b3139e0-d507-4fe5-9d20-4f983ffbeda2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:04.510674 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1b3139e0-d507-4fe5-9d20-4f983ffbeda2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:04.511627 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1b3139e0-d507-4fe5-9d20-4f983ffbeda2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:04.512457 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1b3139e0-d507-4fe5-9d20-4f983ffbeda2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:04.540382 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-84d7d896-fc48-4edc-a521-173ff0925690 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb58dd8c77b4808b54874f4dac8501e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bfc73417aa4dacaee5ea501175efb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:04.548739 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-84d7d896-fc48-4edc-a521-173ff0925690 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] 10.222.0.104 "GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b" status: 200 len: 1319 microversion: 2.1 time: 0.379154 Oct 28 09:49:04.554358 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 35/70] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:49:04 2021] GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b => generated 1319 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:04.781696 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-1b3139e0-d507-4fe5-9d20-4f983ffbeda2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:04.788936 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-1b3139e0-d507-4fe5-9d20-4f983ffbeda2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1366 microversion: 2.1 time: 0.291499 Oct 28 09:49:04.789518 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 36/71] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:49:04 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:05.519161 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-1a4d10d7-abb1-4792-be60-f4186fef6204 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:05.519634 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-1a4d10d7-abb1-4792-be60-f4186fef6204 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:05.526748 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1a4d10d7-abb1-4792-be60-f4186fef6204 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:05.527195 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1a4d10d7-abb1-4792-be60-f4186fef6204 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:05.527970 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1a4d10d7-abb1-4792-be60-f4186fef6204 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:05.528394 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1a4d10d7-abb1-4792-be60-f4186fef6204 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:05.570682 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-89b64c43-e350-49e2-8fa2-3e7c9fe9c6d6 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:05.572035 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-89b64c43-e350-49e2-8fa2-3e7c9fe9c6d6 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:05.579623 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-89b64c43-e350-49e2-8fa2-3e7c9fe9c6d6 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:05.580333 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-89b64c43-e350-49e2-8fa2-3e7c9fe9c6d6 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:05.581487 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-89b64c43-e350-49e2-8fa2-3e7c9fe9c6d6 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:05.582066 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-89b64c43-e350-49e2-8fa2-3e7c9fe9c6d6 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:05.791090 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-1a4d10d7-abb1-4792-be60-f4186fef6204 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:05.805747 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-1a4d10d7-abb1-4792-be60-f4186fef6204 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:05.808792 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-1a4d10d7-abb1-4792-be60-f4186fef6204 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:05.810956 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-1a4d10d7-abb1-4792-be60-f4186fef6204 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1412 microversion: 2.20 time: 0.296004 Oct 28 09:49:05.812580 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 36/72] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:49:05 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1412 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:05.827287 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-8e5937bf-754d-4a5b-8adc-f12dc8ba9792 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:05.828064 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-8e5937bf-754d-4a5b-8adc-f12dc8ba9792 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:05.836609 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8e5937bf-754d-4a5b-8adc-f12dc8ba9792 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:05.837295 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8e5937bf-754d-4a5b-8adc-f12dc8ba9792 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:05.838890 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8e5937bf-754d-4a5b-8adc-f12dc8ba9792 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:05.839815 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8e5937bf-754d-4a5b-8adc-f12dc8ba9792 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:05.870667 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-89b64c43-e350-49e2-8fa2-3e7c9fe9c6d6 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb58dd8c77b4808b54874f4dac8501e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bfc73417aa4dacaee5ea501175efb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:05.880696 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-89b64c43-e350-49e2-8fa2-3e7c9fe9c6d6 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] 10.222.0.104 "GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b" status: 200 len: 1505 microversion: 2.1 time: 0.313512 Oct 28 09:49:05.881193 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 37/73] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:49:05 2021] GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b => generated 1505 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:49:06.060564 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-8e5937bf-754d-4a5b-8adc-f12dc8ba9792 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:06.074214 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-8e5937bf-754d-4a5b-8adc-f12dc8ba9792 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1366 microversion: 2.1 time: 0.260135 Oct 28 09:49:06.078631 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 37/74] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:49:05 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:06.223648 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [req-619f748b-91ce-448d-a44a-4e96aff5cd4a req-c9e2c9ad-4225-46d2-be02-b63e71f40c8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a4e433d-b808-4128-9e1e-cd8f5f7e20f4", "name": "network-vif-plugged", "status": "completed", "tag": "a76427d7-3f5c-4e87-ab53-ee0815c5d946"}]} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:06.223648 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:49:06.223648 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 09:49:06.232051 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-619f748b-91ce-448d-a44a-4e96aff5cd4a req-c9e2c9ad-4225-46d2-be02-b63e71f40c8a service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:06.232787 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-619f748b-91ce-448d-a44a-4e96aff5cd4a req-c9e2c9ad-4225-46d2-be02-b63e71f40c8a service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:06.244623 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.compute.server_external_events [req-619f748b-91ce-448d-a44a-4e96aff5cd4a req-c9e2c9ad-4225-46d2-be02-b63e71f40c8a service nova] Creating event network-vif-plugged:a76427d7-3f5c-4e87-ab53-ee0815c5d946 for instance 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 on hv-cinder-81571 Oct 28 09:49:06.250074 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [req-619f748b-91ce-448d-a44a-4e96aff5cd4a req-c9e2c9ad-4225-46d2-be02-b63e71f40c8a service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032245 Oct 28 09:49:06.250672 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 38/75] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:49:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:49:06.830640 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-fd3a99b9-dc11-4fa8-bdc4-73c3606fab1b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:06.831400 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-fd3a99b9-dc11-4fa8-bdc4-73c3606fab1b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:06.837652 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fd3a99b9-dc11-4fa8-bdc4-73c3606fab1b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:06.837823 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fd3a99b9-dc11-4fa8-bdc4-73c3606fab1b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:06.838475 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fd3a99b9-dc11-4fa8-bdc4-73c3606fab1b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:06.838893 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fd3a99b9-dc11-4fa8-bdc4-73c3606fab1b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:06.965921 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-fd3a99b9-dc11-4fa8-bdc4-73c3606fab1b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:06.975123 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-fd3a99b9-dc11-4fa8-bdc4-73c3606fab1b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:06.976740 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-fd3a99b9-dc11-4fa8-bdc4-73c3606fab1b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:06.977844 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-fd3a99b9-dc11-4fa8-bdc4-73c3606fab1b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1412 microversion: 2.20 time: 0.151045 Oct 28 09:49:06.978412 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 38/76] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:49:06 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1412 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:07.104198 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-67ef4e7b-ea54-4b02-87e8-29b8746d2fb6 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:07.104198 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-67ef4e7b-ea54-4b02-87e8-29b8746d2fb6 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:07.104198 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-67ef4e7b-ea54-4b02-87e8-29b8746d2fb6 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:07.104198 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-67ef4e7b-ea54-4b02-87e8-29b8746d2fb6 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:07.104945 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-67ef4e7b-ea54-4b02-87e8-29b8746d2fb6 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:07.104945 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-67ef4e7b-ea54-4b02-87e8-29b8746d2fb6 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:07.279712 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-67ef4e7b-ea54-4b02-87e8-29b8746d2fb6 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:07.287432 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-67ef4e7b-ea54-4b02-87e8-29b8746d2fb6 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1366 microversion: 2.1 time: 0.199225 Oct 28 09:49:07.288096 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 39/77] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:49:07 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:07.997587 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-caa24e30-fdde-4acc-bebd-f61946370b82 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:07.998460 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-caa24e30-fdde-4acc-bebd-f61946370b82 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:08.004067 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-caa24e30-fdde-4acc-bebd-f61946370b82 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:08.004506 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-caa24e30-fdde-4acc-bebd-f61946370b82 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:08.005677 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-caa24e30-fdde-4acc-bebd-f61946370b82 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:08.006094 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-caa24e30-fdde-4acc-bebd-f61946370b82 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:08.150827 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-caa24e30-fdde-4acc-bebd-f61946370b82 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:08.154795 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-caa24e30-fdde-4acc-bebd-f61946370b82 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:08.156285 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-caa24e30-fdde-4acc-bebd-f61946370b82 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:08.157419 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-caa24e30-fdde-4acc-bebd-f61946370b82 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1412 microversion: 2.20 time: 0.163699 Oct 28 09:49:08.157976 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 39/78] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:49:07 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1412 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:08.304051 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-1d63228e-4654-46c4-b88a-d85ea184f920 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:08.304672 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-1d63228e-4654-46c4-b88a-d85ea184f920 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:08.316035 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1d63228e-4654-46c4-b88a-d85ea184f920 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:08.316705 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1d63228e-4654-46c4-b88a-d85ea184f920 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:08.325338 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1d63228e-4654-46c4-b88a-d85ea184f920 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:08.326620 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1d63228e-4654-46c4-b88a-d85ea184f920 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:08.339201 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-e36ba5b1-5629-494e-b5f0-fee138ea4348 req-f67e2b19-07b8-4a29-a8a1-9d0acf1f6cd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b49b31e1-36d8-4096-a5fc-b2d46ef922eb", "name": "network-vif-plugged", "status": "completed", "tag": "b51e7b00-09ad-41ca-b851-00805473b75a"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:08.341500 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:49:08.341500 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:49:08.361431 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-e36ba5b1-5629-494e-b5f0-fee138ea4348 req-f67e2b19-07b8-4a29-a8a1-9d0acf1f6cd9 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:08.362046 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-e36ba5b1-5629-494e-b5f0-fee138ea4348 req-f67e2b19-07b8-4a29-a8a1-9d0acf1f6cd9 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:08.375403 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-e36ba5b1-5629-494e-b5f0-fee138ea4348 req-f67e2b19-07b8-4a29-a8a1-9d0acf1f6cd9 service nova] Creating event network-vif-plugged:b51e7b00-09ad-41ca-b851-00805473b75a for instance b49b31e1-36d8-4096-a5fc-b2d46ef922eb on hv-cinder-81571 Oct 28 09:49:08.381184 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-e36ba5b1-5629-494e-b5f0-fee138ea4348 req-f67e2b19-07b8-4a29-a8a1-9d0acf1f6cd9 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045934 Oct 28 09:49:08.381974 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 40/79] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:49:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:49:08.491092 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-1d63228e-4654-46c4-b88a-d85ea184f920 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:08.499524 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-1d63228e-4654-46c4-b88a-d85ea184f920 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1552 microversion: 2.1 time: 0.199064 Oct 28 09:49:08.500215 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 40/80] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:49:08 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1552 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:08.525015 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-051bd7db-b00c-4465-949e-882601613078 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:08.525590 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-051bd7db-b00c-4465-949e-882601613078 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:08.532155 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-051bd7db-b00c-4465-949e-882601613078 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:08.532682 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-051bd7db-b00c-4465-949e-882601613078 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:08.533467 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-051bd7db-b00c-4465-949e-882601613078 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:08.533896 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-051bd7db-b00c-4465-949e-882601613078 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:08.673268 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-051bd7db-b00c-4465-949e-882601613078 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.151604 Oct 28 09:49:08.674975 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 41/81] 10.222.0.104 () {58 vars in 1279 bytes} [Thu Oct 28 09:49:08 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/os-interface => generated 285 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:49:08.757261 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-c35bb5e6-682f-42da-96bd-8aec81d0e918 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8241103b-ae5e-4c82-9b1b-208cc6724f88"}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:08.758572 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-c35bb5e6-682f-42da-96bd-8aec81d0e918 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:08.771435 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c35bb5e6-682f-42da-96bd-8aec81d0e918 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:08.771435 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c35bb5e6-682f-42da-96bd-8aec81d0e918 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:08.771435 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c35bb5e6-682f-42da-96bd-8aec81d0e918 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:08.771435 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c35bb5e6-682f-42da-96bd-8aec81d0e918 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:09.174953 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-8b2b8dc1-0943-4e5e-85f8-00343df3cea0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:09.175553 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-8b2b8dc1-0943-4e5e-85f8-00343df3cea0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:09.181344 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8b2b8dc1-0943-4e5e-85f8-00343df3cea0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:09.182787 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8b2b8dc1-0943-4e5e-85f8-00343df3cea0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:09.182787 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8b2b8dc1-0943-4e5e-85f8-00343df3cea0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:09.183133 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8b2b8dc1-0943-4e5e-85f8-00343df3cea0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:09.702489 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-8b2b8dc1-0943-4e5e-85f8-00343df3cea0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:09.710997 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-8b2b8dc1-0943-4e5e-85f8-00343df3cea0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:09.712632 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-8b2b8dc1-0943-4e5e-85f8-00343df3cea0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:09.725180 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-8b2b8dc1-0943-4e5e-85f8-00343df3cea0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1412 microversion: 2.20 time: 0.543194 Oct 28 09:49:09.725180 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 42/82] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:49:09 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1412 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:49:10.259838 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-81fd1f32-6375-4e01-b857-7712b6cea8f4 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:10.261482 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-81fd1f32-6375-4e01-b857-7712b6cea8f4 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:10.269154 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-81fd1f32-6375-4e01-b857-7712b6cea8f4 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:10.269592 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-81fd1f32-6375-4e01-b857-7712b6cea8f4 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:10.270364 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-81fd1f32-6375-4e01-b857-7712b6cea8f4 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:10.270824 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-81fd1f32-6375-4e01-b857-7712b6cea8f4 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:11.319858 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-81fd1f32-6375-4e01-b857-7712b6cea8f4 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 200 len: 14 microversion: 2.1 time: 1.064060 Oct 28 09:49:11.320800 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 43/83] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:49:10 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 14 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 09:49:11.327897 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-65899716-f59c-456e-8eef-9dcd2f3b9b39 req-aa3f35c4-67c2-4909-93ea-d65c1f7358de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a4e433d-b808-4128-9e1e-cd8f5f7e20f4", "tag": "a76427d7-3f5c-4e87-ab53-ee0815c5d946"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:11.329903 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:49:11.329903 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:49:11.339140 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-65899716-f59c-456e-8eef-9dcd2f3b9b39 req-aa3f35c4-67c2-4909-93ea-d65c1f7358de service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:11.339643 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-65899716-f59c-456e-8eef-9dcd2f3b9b39 req-aa3f35c4-67c2-4909-93ea-d65c1f7358de service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:11.373418 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-65899716-f59c-456e-8eef-9dcd2f3b9b39 req-aa3f35c4-67c2-4909-93ea-d65c1f7358de service nova] Creating event network-changed:a76427d7-3f5c-4e87-ab53-ee0815c5d946 for instance 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 on hv-cinder-81571 Oct 28 09:49:11.373418 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-65899716-f59c-456e-8eef-9dcd2f3b9b39 req-aa3f35c4-67c2-4909-93ea-d65c1f7358de service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036437 Oct 28 09:49:11.373418 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 44/84] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:49:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:49:11.373418 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-cbb4cb42-6ca2-4489-8a65-3c094f1bef7b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:11.373418 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-cbb4cb42-6ca2-4489-8a65-3c094f1bef7b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:11.374424 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cbb4cb42-6ca2-4489-8a65-3c094f1bef7b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:11.374424 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cbb4cb42-6ca2-4489-8a65-3c094f1bef7b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:11.374623 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cbb4cb42-6ca2-4489-8a65-3c094f1bef7b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:11.374930 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cbb4cb42-6ca2-4489-8a65-3c094f1bef7b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:11.525596 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-cbb4cb42-6ca2-4489-8a65-3c094f1bef7b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:11.534212 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-cbb4cb42-6ca2-4489-8a65-3c094f1bef7b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:11.535720 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-cbb4cb42-6ca2-4489-8a65-3c094f1bef7b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:11.536887 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-cbb4cb42-6ca2-4489-8a65-3c094f1bef7b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1412 microversion: 2.20 time: 0.175500 Oct 28 09:49:11.537463 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 45/85] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:49:11 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1412 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:12.333455 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-520aec48-3ddf-4986-84b2-eca2261ee83a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:12.336891 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-520aec48-3ddf-4986-84b2-eca2261ee83a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:12.341737 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-520aec48-3ddf-4986-84b2-eca2261ee83a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:12.342179 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-520aec48-3ddf-4986-84b2-eca2261ee83a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:12.342978 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-520aec48-3ddf-4986-84b2-eca2261ee83a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:12.344129 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-520aec48-3ddf-4986-84b2-eca2261ee83a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:12.552470 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-c35bb5e6-682f-42da-96bd-8aec81d0e918 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] 10.222.0.104 "POST /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.798116 Oct 28 09:49:12.553713 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 41/86] 10.222.0.104 () {60 vars in 1327 bytes} [Thu Oct 28 09:49:08 2021] POST /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b/os-volume_attachments => generated 194 bytes in 3801 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:49:12.562489 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-7480878b-cd1a-4da7-ae73-a6e073ff715e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:12.563642 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-7480878b-cd1a-4da7-ae73-a6e073ff715e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:12.574929 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7480878b-cd1a-4da7-ae73-a6e073ff715e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:12.576394 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7480878b-cd1a-4da7-ae73-a6e073ff715e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:12.578234 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7480878b-cd1a-4da7-ae73-a6e073ff715e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:12.586313 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7480878b-cd1a-4da7-ae73-a6e073ff715e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:12.759851 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-7480878b-cd1a-4da7-ae73-a6e073ff715e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:12.777357 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-7480878b-cd1a-4da7-ae73-a6e073ff715e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:12.779946 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-7480878b-cd1a-4da7-ae73-a6e073ff715e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:12.781200 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-7480878b-cd1a-4da7-ae73-a6e073ff715e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1412 microversion: 2.20 time: 0.225911 Oct 28 09:49:12.781759 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 42/87] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:49:12 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1412 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:13.799855 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-7e7940c9-fe7e-4661-b2d2-c64a478d5274 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:13.800470 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-7e7940c9-fe7e-4661-b2d2-c64a478d5274 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:13.815493 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7e7940c9-fe7e-4661-b2d2-c64a478d5274 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:13.815493 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7e7940c9-fe7e-4661-b2d2-c64a478d5274 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:13.815493 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7e7940c9-fe7e-4661-b2d2-c64a478d5274 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:13.815493 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7e7940c9-fe7e-4661-b2d2-c64a478d5274 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:13.966383 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-7e7940c9-fe7e-4661-b2d2-c64a478d5274 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:13.975296 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-7e7940c9-fe7e-4661-b2d2-c64a478d5274 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:13.980040 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-7e7940c9-fe7e-4661-b2d2-c64a478d5274 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:13.980040 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-7e7940c9-fe7e-4661-b2d2-c64a478d5274 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1412 microversion: 2.20 time: 0.181934 Oct 28 09:49:13.980040 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 43/88] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:49:13 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1412 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:49:14.567395 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-520aec48-3ddf-4986-84b2-eca2261ee83a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 200 len: 14 microversion: 2.1 time: 2.238789 Oct 28 09:49:14.568135 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 46/89] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:49:12 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 14 bytes in 2240 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 09:49:14.998321 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-63a53dc3-4c44-4b9c-84c8-264d3344829b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:14.999675 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-63a53dc3-4c44-4b9c-84c8-264d3344829b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:15.008553 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-63a53dc3-4c44-4b9c-84c8-264d3344829b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:15.009125 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-63a53dc3-4c44-4b9c-84c8-264d3344829b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:15.009990 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-63a53dc3-4c44-4b9c-84c8-264d3344829b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:15.010497 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-63a53dc3-4c44-4b9c-84c8-264d3344829b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:15.182145 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-63a53dc3-4c44-4b9c-84c8-264d3344829b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:15.204838 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-63a53dc3-4c44-4b9c-84c8-264d3344829b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:15.204838 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-63a53dc3-4c44-4b9c-84c8-264d3344829b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:15.204838 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-63a53dc3-4c44-4b9c-84c8-264d3344829b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1412 microversion: 2.20 time: 0.202709 Oct 28 09:49:15.205409 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 44/90] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:49:14 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1412 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:49:15.579929 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-ad2767a5-a8b0-485a-984f-107bb7125309 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:15.581101 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-ad2767a5-a8b0-485a-984f-107bb7125309 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:15.588238 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ad2767a5-a8b0-485a-984f-107bb7125309 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:15.588780 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ad2767a5-a8b0-485a-984f-107bb7125309 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:15.589588 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ad2767a5-a8b0-485a-984f-107bb7125309 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:15.590035 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ad2767a5-a8b0-485a-984f-107bb7125309 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:15.671229 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-ad2767a5-a8b0-485a-984f-107bb7125309 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 200 len: 14 microversion: 2.1 time: 0.096030 Oct 28 09:49:15.672071 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 47/91] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:49:15 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:49:16.216299 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-022ecd26-a6e4-464d-af59-320c7144fb8d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:16.217475 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-022ecd26-a6e4-464d-af59-320c7144fb8d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:16.227372 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-022ecd26-a6e4-464d-af59-320c7144fb8d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:16.227823 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-022ecd26-a6e4-464d-af59-320c7144fb8d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:16.228610 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-022ecd26-a6e4-464d-af59-320c7144fb8d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:16.229066 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-022ecd26-a6e4-464d-af59-320c7144fb8d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:16.364945 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-022ecd26-a6e4-464d-af59-320c7144fb8d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:16.369808 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-022ecd26-a6e4-464d-af59-320c7144fb8d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:16.371451 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-022ecd26-a6e4-464d-af59-320c7144fb8d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:16.373447 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-022ecd26-a6e4-464d-af59-320c7144fb8d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1604 microversion: 2.20 time: 0.161439 Oct 28 09:49:16.374016 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 45/92] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:49:16 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1604 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:49:16.392754 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-fe57efe4-5418-477f-aaec-8474347930a1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:16.400899 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-fe57efe4-5418-477f-aaec-8474347930a1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:16.400899 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fe57efe4-5418-477f-aaec-8474347930a1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:16.401203 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fe57efe4-5418-477f-aaec-8474347930a1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:16.401938 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fe57efe4-5418-477f-aaec-8474347930a1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:16.402366 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fe57efe4-5418-477f-aaec-8474347930a1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:16.491625 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-fe57efe4-5418-477f-aaec-8474347930a1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.103503 Oct 28 09:49:16.492217 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 48/93] 10.222.0.104 () {60 vars in 1320 bytes} [Thu Oct 28 09:49:16 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:49:16.682503 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-12396edf-129f-4e48-be48-1206aa2bdf47 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:16.683530 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-12396edf-129f-4e48-be48-1206aa2bdf47 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:16.690251 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-12396edf-129f-4e48-be48-1206aa2bdf47 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:16.690835 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-12396edf-129f-4e48-be48-1206aa2bdf47 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:16.691781 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-12396edf-129f-4e48-be48-1206aa2bdf47 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:16.692355 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-12396edf-129f-4e48-be48-1206aa2bdf47 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:16.755010 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-12396edf-129f-4e48-be48-1206aa2bdf47 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 200 len: 14 microversion: 2.1 time: 0.076088 Oct 28 09:49:16.760862 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 46/94] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:49:16 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:49:17.771020 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-751586d9-2667-4873-a1f4-273603fc735e tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:17.773490 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-751586d9-2667-4873-a1f4-273603fc735e tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:17.782972 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-751586d9-2667-4873-a1f4-273603fc735e tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:17.783763 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-751586d9-2667-4873-a1f4-273603fc735e tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:17.784541 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-751586d9-2667-4873-a1f4-273603fc735e tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:17.785141 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-751586d9-2667-4873-a1f4-273603fc735e tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:17.876867 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-751586d9-2667-4873-a1f4-273603fc735e tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 200 len: 14 microversion: 2.1 time: 0.109547 Oct 28 09:49:17.880206 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 49/95] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:49:17 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:49:17.992051 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-a0c4eaac-aac0-4b06-9eda-6e68fb44224e req-e4a2fd0a-a8a8-473a-9a5b-170e9ea7b0c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b49b31e1-36d8-4096-a5fc-b2d46ef922eb", "tag": "b51e7b00-09ad-41ca-b851-00805473b75a"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:17.995866 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-3b5d8864-ad09-4d22-9ad7-318173ec5b86 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:17.998724 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-3b5d8864-ad09-4d22-9ad7-318173ec5b86 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:18.001770 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:49:18.001770 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:49:18.015259 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3b5d8864-ad09-4d22-9ad7-318173ec5b86 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:18.015783 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3b5d8864-ad09-4d22-9ad7-318173ec5b86 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:18.016844 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3b5d8864-ad09-4d22-9ad7-318173ec5b86 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:18.018335 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-a0c4eaac-aac0-4b06-9eda-6e68fb44224e req-e4a2fd0a-a8a8-473a-9a5b-170e9ea7b0c9 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:18.019118 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3b5d8864-ad09-4d22-9ad7-318173ec5b86 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:18.023486 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-a0c4eaac-aac0-4b06-9eda-6e68fb44224e req-e4a2fd0a-a8a8-473a-9a5b-170e9ea7b0c9 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:18.036430 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-a0c4eaac-aac0-4b06-9eda-6e68fb44224e req-e4a2fd0a-a8a8-473a-9a5b-170e9ea7b0c9 service nova] Creating event network-changed:b51e7b00-09ad-41ca-b851-00805473b75a for instance b49b31e1-36d8-4096-a5fc-b2d46ef922eb on hv-cinder-81571 Oct 28 09:49:18.042552 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-a0c4eaac-aac0-4b06-9eda-6e68fb44224e req-e4a2fd0a-a8a8-473a-9a5b-170e9ea7b0c9 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054327 Oct 28 09:49:18.043169 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 50/96] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:49:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:49:18.888861 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-cc3a9d72-173c-419d-a79f-d3c200e488d9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:18.890577 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-cc3a9d72-173c-419d-a79f-d3c200e488d9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:18.897118 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cc3a9d72-173c-419d-a79f-d3c200e488d9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:18.897760 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cc3a9d72-173c-419d-a79f-d3c200e488d9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:18.901753 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cc3a9d72-173c-419d-a79f-d3c200e488d9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:18.901753 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cc3a9d72-173c-419d-a79f-d3c200e488d9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:21.114304 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-3b5d8864-ad09-4d22-9ad7-318173ec5b86 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 14 microversion: 2.20 time: 3.128114 Oct 28 09:49:21.115062 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 47/97] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:49:17 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 14 bytes in 3130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:21.135471 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-cc3a9d72-173c-419d-a79f-d3c200e488d9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 200 len: 14 microversion: 2.1 time: 2.251164 Oct 28 09:49:21.139142 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 51/98] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:49:18 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 14 bytes in 2256 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:49:22.126751 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-617cc621-f88a-4210-aebd-c595669612a6 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:22.137908 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-617cc621-f88a-4210-aebd-c595669612a6 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:22.147621 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-12224066-bc82-4299-9276-a3ea16f2cc29 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:22.148751 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-12224066-bc82-4299-9276-a3ea16f2cc29 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:22.156241 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-617cc621-f88a-4210-aebd-c595669612a6 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:22.158202 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-617cc621-f88a-4210-aebd-c595669612a6 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:22.159197 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-12224066-bc82-4299-9276-a3ea16f2cc29 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:22.159584 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-617cc621-f88a-4210-aebd-c595669612a6 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:22.159717 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-12224066-bc82-4299-9276-a3ea16f2cc29 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:22.160039 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-617cc621-f88a-4210-aebd-c595669612a6 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:22.160386 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-12224066-bc82-4299-9276-a3ea16f2cc29 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:22.161026 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-12224066-bc82-4299-9276-a3ea16f2cc29 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:22.264308 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-12224066-bc82-4299-9276-a3ea16f2cc29 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 200 len: 14 microversion: 2.1 time: 0.118352 Oct 28 09:49:22.264308 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 52/99] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:49:22 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 09:49:22.265491 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-617cc621-f88a-4210-aebd-c595669612a6 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 14 microversion: 2.20 time: 0.135554 Oct 28 09:49:22.266663 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 48/100] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:49:22 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:23.279008 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-2545e1eb-7687-4823-afe1-fc470588bd3a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:23.281459 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-2545e1eb-7687-4823-afe1-fc470588bd3a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:23.288640 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-0ef5e5d3-23e6-4078-8cb8-08fa92195fb3 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:23.288640 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-0ef5e5d3-23e6-4078-8cb8-08fa92195fb3 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:23.301097 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2545e1eb-7687-4823-afe1-fc470588bd3a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:23.301699 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2545e1eb-7687-4823-afe1-fc470588bd3a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:23.302581 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2545e1eb-7687-4823-afe1-fc470588bd3a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:23.302979 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0ef5e5d3-23e6-4078-8cb8-08fa92195fb3 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:23.303600 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0ef5e5d3-23e6-4078-8cb8-08fa92195fb3 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:23.304209 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2545e1eb-7687-4823-afe1-fc470588bd3a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:23.305318 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0ef5e5d3-23e6-4078-8cb8-08fa92195fb3 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:23.308206 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0ef5e5d3-23e6-4078-8cb8-08fa92195fb3 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:23.407127 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-0ef5e5d3-23e6-4078-8cb8-08fa92195fb3 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 200 len: 14 microversion: 2.1 time: 0.129026 Oct 28 09:49:23.408987 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 49/101] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:49:23 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:49:23.412877 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-2545e1eb-7687-4823-afe1-fc470588bd3a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 14 microversion: 2.20 time: 0.137716 Oct 28 09:49:23.417124 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 53/102] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:49:23 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:24.428009 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-9dc005e1-4ebd-4f05-a28d-904180fe90fc tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:24.428009 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-9dc005e1-4ebd-4f05-a28d-904180fe90fc tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:24.428638 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-1ab3580c-dd97-44c8-9550-53925ba3a645 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:24.428638 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-1ab3580c-dd97-44c8-9550-53925ba3a645 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:24.438227 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1ab3580c-dd97-44c8-9550-53925ba3a645 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:24.438664 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1ab3580c-dd97-44c8-9550-53925ba3a645 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:24.439831 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1ab3580c-dd97-44c8-9550-53925ba3a645 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:24.440003 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1ab3580c-dd97-44c8-9550-53925ba3a645 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:24.451510 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9dc005e1-4ebd-4f05-a28d-904180fe90fc tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:24.451510 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9dc005e1-4ebd-4f05-a28d-904180fe90fc tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:24.451510 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9dc005e1-4ebd-4f05-a28d-904180fe90fc tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:24.451510 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9dc005e1-4ebd-4f05-a28d-904180fe90fc tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:24.560771 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-1ab3580c-dd97-44c8-9550-53925ba3a645 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 14 microversion: 2.20 time: 0.134206 Oct 28 09:49:24.561705 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 54/103] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:49:24 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:49:24.568870 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-fc133f1a-86e3-4ffa-a3a6-ca81b69f6398 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:24.572966 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-fc133f1a-86e3-4ffa-a3a6-ca81b69f6398 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:24.583051 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fc133f1a-86e3-4ffa-a3a6-ca81b69f6398 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:24.583453 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fc133f1a-86e3-4ffa-a3a6-ca81b69f6398 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:24.585393 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fc133f1a-86e3-4ffa-a3a6-ca81b69f6398 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:24.587687 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fc133f1a-86e3-4ffa-a3a6-ca81b69f6398 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:24.615285 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-9dc005e1-4ebd-4f05-a28d-904180fe90fc tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 200 len: 10740 microversion: 2.1 time: 0.199040 Oct 28 09:49:24.616018 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 50/104] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:49:24 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 10740 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:49:24.636116 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-fc133f1a-86e3-4ffa-a3a6-ca81b69f6398 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] Going to try to terminate instance {{(pid=123068) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 09:49:25.259270 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-fc133f1a-86e3-4ffa-a3a6-ca81b69f6398 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] 10.222.0.104 "DELETE /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b" status: 204 len: 0 microversion: 2.1 time: 0.695837 Oct 28 09:49:25.263256 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 55/105] 10.222.0.104 () {58 vars in 1243 bytes} [Thu Oct 28 09:49:24 2021] DELETE /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b => generated 0 bytes in 697 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:49:25.269972 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-f67cbe4d-e513-4d70-bb3b-43865cff314a tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:25.270686 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-f67cbe4d-e513-4d70-bb3b-43865cff314a tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:25.277754 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f67cbe4d-e513-4d70-bb3b-43865cff314a tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:25.278763 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f67cbe4d-e513-4d70-bb3b-43865cff314a tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:25.279947 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f67cbe4d-e513-4d70-bb3b-43865cff314a tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:25.280453 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f67cbe4d-e513-4d70-bb3b-43865cff314a tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:25.448247 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-f67cbe4d-e513-4d70-bb3b-43865cff314a tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb58dd8c77b4808b54874f4dac8501e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bfc73417aa4dacaee5ea501175efb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:25.457820 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-f67cbe4d-e513-4d70-bb3b-43865cff314a tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] 10.222.0.104 "GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b" status: 200 len: 1557 microversion: 2.1 time: 0.192713 Oct 28 09:49:25.458874 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 51/106] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:49:25 2021] GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b => generated 1557 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:25.578113 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-9716e6ca-6b8b-4483-a514-473b971c7199 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:25.579404 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-9716e6ca-6b8b-4483-a514-473b971c7199 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:25.586323 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9716e6ca-6b8b-4483-a514-473b971c7199 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:25.588152 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9716e6ca-6b8b-4483-a514-473b971c7199 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:25.589414 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9716e6ca-6b8b-4483-a514-473b971c7199 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:25.590091 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9716e6ca-6b8b-4483-a514-473b971c7199 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:25.632834 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-8bc25663-9dc4-4e58-bd1d-e32f021bb814 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:25.647955 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-8bc25663-9dc4-4e58-bd1d-e32f021bb814 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:25.678820 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8bc25663-9dc4-4e58-bd1d-e32f021bb814 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:25.682104 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8bc25663-9dc4-4e58-bd1d-e32f021bb814 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:25.683141 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8bc25663-9dc4-4e58-bd1d-e32f021bb814 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:25.683489 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8bc25663-9dc4-4e58-bd1d-e32f021bb814 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:25.685992 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-9716e6ca-6b8b-4483-a514-473b971c7199 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 14 microversion: 2.20 time: 0.112759 Oct 28 09:49:25.695300 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 56/107] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:49:25 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:25.820991 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-8bc25663-9dc4-4e58-bd1d-e32f021bb814 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 200 len: 16319 microversion: 2.1 time: 0.197495 Oct 28 09:49:25.821989 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 52/108] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:49:25 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 16319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:49:26.475893 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-9a004c74-53ff-4423-a5e9-66459e022a00 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:26.476516 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-9a004c74-53ff-4423-a5e9-66459e022a00 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:26.484812 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9a004c74-53ff-4423-a5e9-66459e022a00 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:26.485331 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9a004c74-53ff-4423-a5e9-66459e022a00 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:26.486114 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9a004c74-53ff-4423-a5e9-66459e022a00 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:26.486792 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9a004c74-53ff-4423-a5e9-66459e022a00 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:26.706107 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-4675720f-3225-40e8-9af8-adc459d650ff tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:26.706598 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-4675720f-3225-40e8-9af8-adc459d650ff tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:26.713895 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4675720f-3225-40e8-9af8-adc459d650ff tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:26.714414 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4675720f-3225-40e8-9af8-adc459d650ff tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:26.715578 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4675720f-3225-40e8-9af8-adc459d650ff tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:26.716002 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4675720f-3225-40e8-9af8-adc459d650ff tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:26.752882 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-9a004c74-53ff-4423-a5e9-66459e022a00 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb58dd8c77b4808b54874f4dac8501e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bfc73417aa4dacaee5ea501175efb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:26.773780 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-9a004c74-53ff-4423-a5e9-66459e022a00 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] 10.222.0.104 "GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b" status: 200 len: 1557 microversion: 2.1 time: 0.301935 Oct 28 09:49:26.777640 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 57/109] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:49:26 2021] GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b => generated 1557 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:49:26.808310 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-4675720f-3225-40e8-9af8-adc459d650ff tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 14 microversion: 2.20 time: 0.108470 Oct 28 09:49:26.810062 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 53/110] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:49:26 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:26.834841 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-f3838745-10db-4a24-a05e-e42ffc0654fc tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:26.835965 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-f3838745-10db-4a24-a05e-e42ffc0654fc tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:26.843992 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f3838745-10db-4a24-a05e-e42ffc0654fc tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:26.844493 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f3838745-10db-4a24-a05e-e42ffc0654fc tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:26.845315 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f3838745-10db-4a24-a05e-e42ffc0654fc tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:26.845777 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f3838745-10db-4a24-a05e-e42ffc0654fc tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:26.961771 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-f3838745-10db-4a24-a05e-e42ffc0654fc tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 200 len: 17861 microversion: 2.1 time: 0.129631 Oct 28 09:49:26.962518 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 58/111] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:49:26 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 17861 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:49:27.799603 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-ece28c2f-0549-4b4f-8a76-4368aa3d04f8 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:27.800896 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-ece28c2f-0549-4b4f-8a76-4368aa3d04f8 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:27.807900 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ece28c2f-0549-4b4f-8a76-4368aa3d04f8 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:27.808643 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ece28c2f-0549-4b4f-8a76-4368aa3d04f8 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:27.811359 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ece28c2f-0549-4b4f-8a76-4368aa3d04f8 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:27.812095 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ece28c2f-0549-4b4f-8a76-4368aa3d04f8 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:27.822689 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-a61b40fb-b574-4b4a-ab1b-b50e2e39a24c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:27.826415 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-a61b40fb-b574-4b4a-ab1b-b50e2e39a24c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:27.849414 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a61b40fb-b574-4b4a-ab1b-b50e2e39a24c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:27.855469 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a61b40fb-b574-4b4a-ab1b-b50e2e39a24c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:27.858184 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a61b40fb-b574-4b4a-ab1b-b50e2e39a24c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:27.860315 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a61b40fb-b574-4b4a-ab1b-b50e2e39a24c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:27.944324 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-a61b40fb-b574-4b4a-ab1b-b50e2e39a24c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 14 microversion: 2.20 time: 0.125096 Oct 28 09:49:27.945013 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 59/112] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:49:27 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:27.975814 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-8cab6049-ebe1-4aa4-98cb-0b26a394c998 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:27.977120 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-8cab6049-ebe1-4aa4-98cb-0b26a394c998 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:27.985539 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8cab6049-ebe1-4aa4-98cb-0b26a394c998 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:27.986347 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8cab6049-ebe1-4aa4-98cb-0b26a394c998 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:27.987418 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8cab6049-ebe1-4aa4-98cb-0b26a394c998 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:27.987849 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8cab6049-ebe1-4aa4-98cb-0b26a394c998 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:28.030752 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-ece28c2f-0549-4b4f-8a76-4368aa3d04f8 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb58dd8c77b4808b54874f4dac8501e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bfc73417aa4dacaee5ea501175efb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:28.042681 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-ece28c2f-0549-4b4f-8a76-4368aa3d04f8 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] 10.222.0.104 "GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b" status: 200 len: 1557 microversion: 2.1 time: 0.249403 Oct 28 09:49:28.043284 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 54/113] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:49:27 2021] GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b => generated 1557 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:28.093224 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-8cab6049-ebe1-4aa4-98cb-0b26a394c998 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 200 len: 19342 microversion: 2.1 time: 0.121619 Oct 28 09:49:28.094129 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 60/114] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:49:27 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 19342 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 09:49:28.901830 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [req-76fce15c-90cb-4eb0-b25d-94dc3ae1966e req-35d7314f-54ef-4ca3-97f9-cb082551ec4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5350c012-82d4-49d1-8b70-4eb8fb4d242b", "name": "network-vif-deleted", "tag": "5874a229-cd52-4a12-9711-544832ced32e"}]} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:28.904294 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:49:28.904294 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 09:49:28.912033 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-76fce15c-90cb-4eb0-b25d-94dc3ae1966e req-35d7314f-54ef-4ca3-97f9-cb082551ec4c service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:28.912470 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-76fce15c-90cb-4eb0-b25d-94dc3ae1966e req-35d7314f-54ef-4ca3-97f9-cb082551ec4c service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:28.924626 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.compute.server_external_events [req-76fce15c-90cb-4eb0-b25d-94dc3ae1966e req-35d7314f-54ef-4ca3-97f9-cb082551ec4c service nova] Creating event network-vif-deleted:5874a229-cd52-4a12-9711-544832ced32e for instance 5350c012-82d4-49d1-8b70-4eb8fb4d242b on hv-cinder-81571 Oct 28 09:49:28.929765 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [req-76fce15c-90cb-4eb0-b25d-94dc3ae1966e req-35d7314f-54ef-4ca3-97f9-cb082551ec4c service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031570 Oct 28 09:49:28.930396 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 55/115] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:49:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:49:28.960777 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-53499a41-2939-4abd-b805-7bb69903655c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:28.962114 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-53499a41-2939-4abd-b805-7bb69903655c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:28.974049 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-53499a41-2939-4abd-b805-7bb69903655c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:28.974797 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-53499a41-2939-4abd-b805-7bb69903655c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:28.976060 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-53499a41-2939-4abd-b805-7bb69903655c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:28.976833 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-53499a41-2939-4abd-b805-7bb69903655c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:29.063949 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-53499a41-2939-4abd-b805-7bb69903655c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 14 microversion: 2.20 time: 0.110531 Oct 28 09:49:29.064600 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 61/116] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:49:28 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:29.067753 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-2bd0183a-f28e-42b8-aad5-7924e8774398 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:29.068735 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-2bd0183a-f28e-42b8-aad5-7924e8774398 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:29.077707 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2bd0183a-f28e-42b8-aad5-7924e8774398 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:29.078225 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2bd0183a-f28e-42b8-aad5-7924e8774398 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:29.079004 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2bd0183a-f28e-42b8-aad5-7924e8774398 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:29.079469 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2bd0183a-f28e-42b8-aad5-7924e8774398 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:29.114003 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-68db7ceb-8a53-456e-8232-5a9b76d26fc9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:29.115132 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-68db7ceb-8a53-456e-8232-5a9b76d26fc9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:29.124079 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-68db7ceb-8a53-456e-8232-5a9b76d26fc9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:29.124535 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-68db7ceb-8a53-456e-8232-5a9b76d26fc9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:29.125784 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-68db7ceb-8a53-456e-8232-5a9b76d26fc9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:29.126204 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-68db7ceb-8a53-456e-8232-5a9b76d26fc9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:29.190009 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-2bd0183a-f28e-42b8-aad5-7924e8774398 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb58dd8c77b4808b54874f4dac8501e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bfc73417aa4dacaee5ea501175efb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:29.198299 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-2bd0183a-f28e-42b8-aad5-7924e8774398 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] 10.222.0.104 "GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b" status: 200 len: 1350 microversion: 2.1 time: 0.140521 Oct 28 09:49:29.198897 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 56/117] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:49:29 2021] GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b => generated 1350 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:29.242938 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-68db7ceb-8a53-456e-8232-5a9b76d26fc9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 200 len: 21282 microversion: 2.1 time: 0.133888 Oct 28 09:49:29.243710 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 62/118] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:49:29 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 21282 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 09:49:30.076752 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-a352d75f-2873-4921-8c37-c0600c7aba30 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:30.077699 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-a352d75f-2873-4921-8c37-c0600c7aba30 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:30.083701 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a352d75f-2873-4921-8c37-c0600c7aba30 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:30.089759 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a352d75f-2873-4921-8c37-c0600c7aba30 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:30.089759 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a352d75f-2873-4921-8c37-c0600c7aba30 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:30.089759 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a352d75f-2873-4921-8c37-c0600c7aba30 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:30.187138 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-a352d75f-2873-4921-8c37-c0600c7aba30 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 14 microversion: 2.20 time: 0.114945 Oct 28 09:49:30.187805 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 57/119] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:49:30 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:30.215958 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-9785611d-8a56-4037-80d0-84248be304b6 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:30.216779 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-9785611d-8a56-4037-80d0-84248be304b6 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:30.224527 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9785611d-8a56-4037-80d0-84248be304b6 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:30.225048 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9785611d-8a56-4037-80d0-84248be304b6 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:30.225825 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9785611d-8a56-4037-80d0-84248be304b6 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:30.226271 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9785611d-8a56-4037-80d0-84248be304b6 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:30.257190 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-1cf0dab1-1e3e-435a-ae96-7c5543f6474a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:30.258836 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-1cf0dab1-1e3e-435a-ae96-7c5543f6474a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:30.270447 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1cf0dab1-1e3e-435a-ae96-7c5543f6474a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:30.270447 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1cf0dab1-1e3e-435a-ae96-7c5543f6474a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:30.270447 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1cf0dab1-1e3e-435a-ae96-7c5543f6474a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:30.270869 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1cf0dab1-1e3e-435a-ae96-7c5543f6474a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:30.271820 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9785611d-8a56-4037-80d0-84248be304b6 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:30.272379 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9785611d-8a56-4037-80d0-84248be304b6 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:30.273035 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.objects.instance [None req-9785611d-8a56-4037-80d0-84248be304b6 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lazy-loading 'fault' on Instance uuid 5350c012-82d4-49d1-8b70-4eb8fb4d242b {{(pid=123068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 09:49:30.370452 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-9785611d-8a56-4037-80d0-84248be304b6 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb58dd8c77b4808b54874f4dac8501e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bfc73417aa4dacaee5ea501175efb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:30.375189 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-1cf0dab1-1e3e-435a-ae96-7c5543f6474a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 200 len: 22885 microversion: 2.1 time: 0.121724 Oct 28 09:49:30.376294 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 58/120] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:49:30 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 22885 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:49:30.397428 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-9785611d-8a56-4037-80d0-84248be304b6 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] 10.222.0.104 "GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b" status: 200 len: 1355 microversion: 2.1 time: 0.185029 Oct 28 09:49:30.399064 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 63/121] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:49:30 2021] GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b => generated 1355 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:49:31.201729 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-7e156dc6-fa66-4c9e-ae47-c712f0000dcd tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:31.202559 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-7e156dc6-fa66-4c9e-ae47-c712f0000dcd tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:31.209702 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7e156dc6-fa66-4c9e-ae47-c712f0000dcd tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:31.210135 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7e156dc6-fa66-4c9e-ae47-c712f0000dcd tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:31.210961 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7e156dc6-fa66-4c9e-ae47-c712f0000dcd tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:31.211407 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7e156dc6-fa66-4c9e-ae47-c712f0000dcd tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:31.388269 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-c247f1b7-e72d-46cd-a6b2-9e1300969130 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:31.389598 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-c247f1b7-e72d-46cd-a6b2-9e1300969130 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:31.396885 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c247f1b7-e72d-46cd-a6b2-9e1300969130 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:31.397539 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c247f1b7-e72d-46cd-a6b2-9e1300969130 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:31.398516 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c247f1b7-e72d-46cd-a6b2-9e1300969130 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:31.398994 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c247f1b7-e72d-46cd-a6b2-9e1300969130 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:33.924161 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-7e156dc6-fa66-4c9e-ae47-c712f0000dcd tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 15025 microversion: 2.20 time: 2.721181 Oct 28 09:49:33.924161 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 59/122] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:49:31 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 15025 bytes in 2723 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:49:33.932085 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-d98a0296-ad5f-4844-922f-3bf35870a3c1 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:33.932085 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-d98a0296-ad5f-4844-922f-3bf35870a3c1 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:33.937340 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d98a0296-ad5f-4844-922f-3bf35870a3c1 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:33.937930 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d98a0296-ad5f-4844-922f-3bf35870a3c1 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:33.938844 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d98a0296-ad5f-4844-922f-3bf35870a3c1 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:33.939498 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d98a0296-ad5f-4844-922f-3bf35870a3c1 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:33.948399 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-c247f1b7-e72d-46cd-a6b2-9e1300969130 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 200 len: 26564 microversion: 2.1 time: 2.564249 Oct 28 09:49:33.952172 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 64/123] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:49:31 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 26564 bytes in 2569 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:49:33.963008 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.wsgi [None req-d98a0296-ad5f-4844-922f-3bf35870a3c1 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] HTTP exception thrown: Instance 5350c012-82d4-49d1-8b70-4eb8fb4d242b could not be found. Oct 28 09:49:33.963199 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-d98a0296-ad5f-4844-922f-3bf35870a3c1 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Returning 404 to user: Instance 5350c012-82d4-49d1-8b70-4eb8fb4d242b could not be found. {{(pid=123069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:49:33.963946 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-d98a0296-ad5f-4844-922f-3bf35870a3c1 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] 10.222.0.104 "GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b" status: 404 len: 111 microversion: 2.1 time: 0.043847 Oct 28 09:49:33.964508 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 60/124] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:49:33 2021] GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:49:34.113117 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-fd33e0c3-985d-4102-bf05-759853f6ecf0 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:34.114134 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-fd33e0c3-985d-4102-bf05-759853f6ecf0 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:34.122257 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fd33e0c3-985d-4102-bf05-759853f6ecf0 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:34.123179 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fd33e0c3-985d-4102-bf05-759853f6ecf0 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:34.124204 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fd33e0c3-985d-4102-bf05-759853f6ecf0 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:34.124632 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fd33e0c3-985d-4102-bf05-759853f6ecf0 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:34.144849 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.wsgi [None req-fd33e0c3-985d-4102-bf05-759853f6ecf0 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] HTTP exception thrown: Instance 5350c012-82d4-49d1-8b70-4eb8fb4d242b could not be found. Oct 28 09:49:34.145676 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-fd33e0c3-985d-4102-bf05-759853f6ecf0 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Returning 404 to user: Instance 5350c012-82d4-49d1-8b70-4eb8fb4d242b could not be found. {{(pid=123068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:49:34.146872 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-fd33e0c3-985d-4102-bf05-759853f6ecf0 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] 10.222.0.104 "GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038162 Oct 28 09:49:34.153590 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 65/125] 10.222.0.104 () {58 vars in 1306 bytes} [Thu Oct 28 09:49:34 2021] GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b/os-volume_attachments => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:49:34.932600 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-635281b9-d952-4bcf-9948-a83c0a5010d3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:34.935002 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-635281b9-d952-4bcf-9948-a83c0a5010d3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:34.942440 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-635281b9-d952-4bcf-9948-a83c0a5010d3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:34.943164 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-635281b9-d952-4bcf-9948-a83c0a5010d3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:34.943944 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-635281b9-d952-4bcf-9948-a83c0a5010d3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:34.944533 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-635281b9-d952-4bcf-9948-a83c0a5010d3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:34.971641 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-ac664e38-5db1-49fe-aaff-8f43a728e622 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:34.972919 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-ac664e38-5db1-49fe-aaff-8f43a728e622 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:34.990500 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ac664e38-5db1-49fe-aaff-8f43a728e622 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:34.991297 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ac664e38-5db1-49fe-aaff-8f43a728e622 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:34.992275 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ac664e38-5db1-49fe-aaff-8f43a728e622 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:34.993085 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ac664e38-5db1-49fe-aaff-8f43a728e622 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:35.026127 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-635281b9-d952-4bcf-9948-a83c0a5010d3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 18208 microversion: 2.20 time: 0.097648 Oct 28 09:49:35.027200 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 61/126] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:49:34 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 18208 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 09:49:35.095685 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-ac664e38-5db1-49fe-aaff-8f43a728e622 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 200 len: 27201 microversion: 2.1 time: 0.128531 Oct 28 09:49:35.096572 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 66/127] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:49:34 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 27201 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 09:49:35.593396 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-0af5aa53-cfd4-469f-9b6d-7003e5fc9b70 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:35.594349 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-0af5aa53-cfd4-469f-9b6d-7003e5fc9b70 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:35.604150 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0af5aa53-cfd4-469f-9b6d-7003e5fc9b70 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:35.605399 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0af5aa53-cfd4-469f-9b6d-7003e5fc9b70 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:35.610140 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0af5aa53-cfd4-469f-9b6d-7003e5fc9b70 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:35.610140 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0af5aa53-cfd4-469f-9b6d-7003e5fc9b70 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:35.631880 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.wsgi [None req-0af5aa53-cfd4-469f-9b6d-7003e5fc9b70 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] HTTP exception thrown: Instance 5350c012-82d4-49d1-8b70-4eb8fb4d242b could not be found. Oct 28 09:49:35.632870 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-0af5aa53-cfd4-469f-9b6d-7003e5fc9b70 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Returning 404 to user: Instance 5350c012-82d4-49d1-8b70-4eb8fb4d242b could not be found. {{(pid=123069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:49:35.633874 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-0af5aa53-cfd4-469f-9b6d-7003e5fc9b70 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] 10.222.0.104 "DELETE /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b" status: 404 len: 111 microversion: 2.1 time: 0.046201 Oct 28 09:49:35.635494 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 62/128] 10.222.0.104 () {58 vars in 1243 bytes} [Thu Oct 28 09:49:35 2021] DELETE /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:49:35.651966 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-f741488e-4104-4943-a763-245ea4c22462 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:35.651966 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-f741488e-4104-4943-a763-245ea4c22462 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] [instance: 5350c012-82d4-49d1-8b70-4eb8fb4d242b] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:35.678959 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f741488e-4104-4943-a763-245ea4c22462 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:35.679558 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f741488e-4104-4943-a763-245ea4c22462 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:35.680446 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f741488e-4104-4943-a763-245ea4c22462 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:35.681020 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f741488e-4104-4943-a763-245ea4c22462 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:35.697693 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.wsgi [None req-f741488e-4104-4943-a763-245ea4c22462 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] HTTP exception thrown: Instance 5350c012-82d4-49d1-8b70-4eb8fb4d242b could not be found. Oct 28 09:49:35.698303 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-f741488e-4104-4943-a763-245ea4c22462 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] Returning 404 to user: Instance 5350c012-82d4-49d1-8b70-4eb8fb4d242b could not be found. {{(pid=123068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:49:35.699131 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-f741488e-4104-4943-a763-245ea4c22462 tempest-DeleteServersTestJSON-1404580202 tempest-DeleteServersTestJSON-1404580202-project] 10.222.0.104 "GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b" status: 404 len: 111 microversion: 2.1 time: 0.056746 Oct 28 09:49:35.700263 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 67/129] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:49:35 2021] GET /compute/v2.1/servers/5350c012-82d4-49d1-8b70-4eb8fb4d242b => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:49:36.040608 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-81bbba9f-22f9-4799-bce1-653505d08e63 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:36.042963 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-81bbba9f-22f9-4799-bce1-653505d08e63 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:36.053498 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-81bbba9f-22f9-4799-bce1-653505d08e63 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:36.054270 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-81bbba9f-22f9-4799-bce1-653505d08e63 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:36.055766 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-81bbba9f-22f9-4799-bce1-653505d08e63 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:36.056597 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-81bbba9f-22f9-4799-bce1-653505d08e63 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:36.112594 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-46c084aa-48ea-4ee3-b33c-198c2c258aff tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:36.113549 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-46c084aa-48ea-4ee3-b33c-198c2c258aff tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:36.123559 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-46c084aa-48ea-4ee3-b33c-198c2c258aff tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:36.124290 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-46c084aa-48ea-4ee3-b33c-198c2c258aff tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:36.125447 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-46c084aa-48ea-4ee3-b33c-198c2c258aff tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:36.126021 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-46c084aa-48ea-4ee3-b33c-198c2c258aff tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:36.162809 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-81bbba9f-22f9-4799-bce1-653505d08e63 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 19342 microversion: 2.20 time: 0.127747 Oct 28 09:49:36.163443 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 63/130] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:49:36 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 19342 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:49:36.210391 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-46c084aa-48ea-4ee3-b33c-198c2c258aff tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 200 len: 27619 microversion: 2.1 time: 0.105450 Oct 28 09:49:36.211183 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 68/131] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:49:36 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 27619 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 09:49:37.175011 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-9fccea90-ba12-452c-b06f-1740018ccfd9 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:37.176416 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-9fccea90-ba12-452c-b06f-1740018ccfd9 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:37.186115 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9fccea90-ba12-452c-b06f-1740018ccfd9 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:37.186115 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9fccea90-ba12-452c-b06f-1740018ccfd9 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:37.186115 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9fccea90-ba12-452c-b06f-1740018ccfd9 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:37.186772 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9fccea90-ba12-452c-b06f-1740018ccfd9 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:37.223602 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-6f764f67-f0b8-4ad4-9a4d-c4f228a66bb0 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:37.224980 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-6f764f67-f0b8-4ad4-9a4d-c4f228a66bb0 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:37.232374 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6f764f67-f0b8-4ad4-9a4d-c4f228a66bb0 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:37.233333 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6f764f67-f0b8-4ad4-9a4d-c4f228a66bb0 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:37.242009 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6f764f67-f0b8-4ad4-9a4d-c4f228a66bb0 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:37.242645 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6f764f67-f0b8-4ad4-9a4d-c4f228a66bb0 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:37.275367 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-9fccea90-ba12-452c-b06f-1740018ccfd9 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 20997 microversion: 2.20 time: 0.104128 Oct 28 09:49:37.275958 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 64/132] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:49:37 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 20997 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:49:37.337327 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-6f764f67-f0b8-4ad4-9a4d-c4f228a66bb0 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 200 len: 27955 microversion: 2.1 time: 0.118609 Oct 28 09:49:37.342391 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 69/133] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:49:37 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 27955 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 09:49:38.288633 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-bdc38407-1a0d-42e3-9aa7-64f31bc2482b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:38.292848 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-bdc38407-1a0d-42e3-9aa7-64f31bc2482b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:38.298187 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bdc38407-1a0d-42e3-9aa7-64f31bc2482b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:38.298809 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bdc38407-1a0d-42e3-9aa7-64f31bc2482b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:38.299692 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bdc38407-1a0d-42e3-9aa7-64f31bc2482b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:38.300188 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bdc38407-1a0d-42e3-9aa7-64f31bc2482b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:38.355392 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-6ff59915-a488-4a30-af56-ae905d018c06 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:38.355392 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-6ff59915-a488-4a30-af56-ae905d018c06 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:38.369967 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6ff59915-a488-4a30-af56-ae905d018c06 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:38.370710 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6ff59915-a488-4a30-af56-ae905d018c06 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:38.372309 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6ff59915-a488-4a30-af56-ae905d018c06 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:38.372901 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6ff59915-a488-4a30-af56-ae905d018c06 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:38.388413 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-bdc38407-1a0d-42e3-9aa7-64f31bc2482b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 22771 microversion: 2.20 time: 0.097768 Oct 28 09:49:38.388413 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 65/134] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:49:38 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 22771 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:49:38.485882 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-6ff59915-a488-4a30-af56-ae905d018c06 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 200 len: 28145 microversion: 2.1 time: 0.137458 Oct 28 09:49:38.489596 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 70/135] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:49:38 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 28145 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:49:39.406020 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-5500fa79-2638-41ee-a75c-c2b628e659d0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:39.406020 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-5500fa79-2638-41ee-a75c-c2b628e659d0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:39.438780 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5500fa79-2638-41ee-a75c-c2b628e659d0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:39.439409 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5500fa79-2638-41ee-a75c-c2b628e659d0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:39.440269 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5500fa79-2638-41ee-a75c-c2b628e659d0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:39.440922 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5500fa79-2638-41ee-a75c-c2b628e659d0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:39.499823 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-47a58c5a-900a-4de0-8c8d-f50a2c98982a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:39.501052 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-47a58c5a-900a-4de0-8c8d-f50a2c98982a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:39.510104 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-47a58c5a-900a-4de0-8c8d-f50a2c98982a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:39.511281 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-47a58c5a-900a-4de0-8c8d-f50a2c98982a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:39.512106 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-47a58c5a-900a-4de0-8c8d-f50a2c98982a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:39.513333 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-47a58c5a-900a-4de0-8c8d-f50a2c98982a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:39.549084 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-5500fa79-2638-41ee-a75c-c2b628e659d0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 24055 microversion: 2.20 time: 0.153871 Oct 28 09:49:39.566399 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 66/136] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:49:39 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 24055 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:49:39.622609 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-47a58c5a-900a-4de0-8c8d-f50a2c98982a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 200 len: 28412 microversion: 2.1 time: 0.125940 Oct 28 09:49:39.628164 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 71/137] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:49:39 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 28412 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:49:40.564572 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-8b7f8268-47eb-488f-9ea7-25215b5ff2a1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:40.567005 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-8b7f8268-47eb-488f-9ea7-25215b5ff2a1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:40.573946 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8b7f8268-47eb-488f-9ea7-25215b5ff2a1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:40.575106 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8b7f8268-47eb-488f-9ea7-25215b5ff2a1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:40.575980 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8b7f8268-47eb-488f-9ea7-25215b5ff2a1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:40.576430 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8b7f8268-47eb-488f-9ea7-25215b5ff2a1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:40.636628 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-6e0fb3e7-b5cc-4e7f-b572-534b17c25fbd tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:40.638400 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-6e0fb3e7-b5cc-4e7f-b572-534b17c25fbd tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:40.646128 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6e0fb3e7-b5cc-4e7f-b572-534b17c25fbd tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:40.646659 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6e0fb3e7-b5cc-4e7f-b572-534b17c25fbd tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:40.647506 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6e0fb3e7-b5cc-4e7f-b572-534b17c25fbd tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:40.648004 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6e0fb3e7-b5cc-4e7f-b572-534b17c25fbd tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:40.670384 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-8b7f8268-47eb-488f-9ea7-25215b5ff2a1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 25553 microversion: 2.20 time: 0.109882 Oct 28 09:49:40.671514 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 67/138] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:49:40 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 25553 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:49:40.735514 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-6e0fb3e7-b5cc-4e7f-b572-534b17c25fbd tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 200 len: 28434 microversion: 2.1 time: 0.103912 Oct 28 09:49:40.736471 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 72/139] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:49:40 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 28434 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:49:41.682871 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-fc79f077-6517-4429-9c82-224edd5360b1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:41.684193 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-fc79f077-6517-4429-9c82-224edd5360b1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:41.691870 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fc79f077-6517-4429-9c82-224edd5360b1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:41.692319 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fc79f077-6517-4429-9c82-224edd5360b1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:41.693193 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fc79f077-6517-4429-9c82-224edd5360b1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:41.693660 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fc79f077-6517-4429-9c82-224edd5360b1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:41.751142 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-769e2004-970b-4d88-9331-0ca576204403 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:41.752602 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-769e2004-970b-4d88-9331-0ca576204403 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:41.772469 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-769e2004-970b-4d88-9331-0ca576204403 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:41.773561 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-769e2004-970b-4d88-9331-0ca576204403 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:41.775209 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-769e2004-970b-4d88-9331-0ca576204403 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:41.776028 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-769e2004-970b-4d88-9331-0ca576204403 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:44.504963 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-fc79f077-6517-4429-9c82-224edd5360b1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 27782 microversion: 2.20 time: 2.824408 Oct 28 09:49:44.509419 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 68/140] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:49:41 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 27782 bytes in 2828 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:49:44.535137 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-769e2004-970b-4d88-9331-0ca576204403 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 200 len: 28602 microversion: 2.1 time: 2.789140 Oct 28 09:49:44.536800 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 73/141] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:49:41 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 28602 bytes in 2793 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:49:45.522585 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-30c8dd44-3c5f-4f78-b324-8de0ee057511 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:45.525098 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-30c8dd44-3c5f-4f78-b324-8de0ee057511 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:45.540170 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-30c8dd44-3c5f-4f78-b324-8de0ee057511 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:45.540927 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-30c8dd44-3c5f-4f78-b324-8de0ee057511 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:45.542138 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-30c8dd44-3c5f-4f78-b324-8de0ee057511 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:45.550858 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-efdf34ed-d2d9-439a-880b-99de05e16b25 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:45.554771 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-efdf34ed-d2d9-439a-880b-99de05e16b25 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:45.561794 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-30c8dd44-3c5f-4f78-b324-8de0ee057511 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:45.573817 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-efdf34ed-d2d9-439a-880b-99de05e16b25 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:45.575980 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-efdf34ed-d2d9-439a-880b-99de05e16b25 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:45.579658 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-efdf34ed-d2d9-439a-880b-99de05e16b25 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:45.580814 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-efdf34ed-d2d9-439a-880b-99de05e16b25 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:45.660142 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-30c8dd44-3c5f-4f78-b324-8de0ee057511 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 28209 microversion: 2.20 time: 0.142962 Oct 28 09:49:45.660902 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 69/142] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:49:45 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 28209 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 09:49:45.701242 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-efdf34ed-d2d9-439a-880b-99de05e16b25 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.154773 Oct 28 09:49:45.707313 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 74/143] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:49:45 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 28602 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:49:46.674324 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-ddb07d8a-078b-4be7-a4b0-e1620d1e6153 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:46.676455 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-ddb07d8a-078b-4be7-a4b0-e1620d1e6153 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:46.688560 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ddb07d8a-078b-4be7-a4b0-e1620d1e6153 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:46.689526 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ddb07d8a-078b-4be7-a4b0-e1620d1e6153 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:46.690974 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ddb07d8a-078b-4be7-a4b0-e1620d1e6153 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:46.692047 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ddb07d8a-078b-4be7-a4b0-e1620d1e6153 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:46.717171 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-4fac3600-a7b9-4e93-aa44-b912b4d33f5f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:46.719907 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-4fac3600-a7b9-4e93-aa44-b912b4d33f5f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:46.735481 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4fac3600-a7b9-4e93-aa44-b912b4d33f5f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:46.736461 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4fac3600-a7b9-4e93-aa44-b912b4d33f5f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:46.738846 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4fac3600-a7b9-4e93-aa44-b912b4d33f5f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:46.740412 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4fac3600-a7b9-4e93-aa44-b912b4d33f5f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:49.363818 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-ddb07d8a-078b-4be7-a4b0-e1620d1e6153 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 28209 microversion: 2.20 time: 2.695211 Oct 28 09:49:49.364711 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 70/144] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:49:46 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 28209 bytes in 2698 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:49:49.378897 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-4fac3600-a7b9-4e93-aa44-b912b4d33f5f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 200 len: 28602 microversion: 2.1 time: 2.668214 Oct 28 09:49:49.379994 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 75/145] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:49:46 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 28602 bytes in 2670 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:49:49.678305 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-3f0f03ad-d45a-4479-8035-067a27e8154c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1319381636", "imageRef": "623b30fc-1d92-46d9-b556-b9b963f3d76c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b96d6b4c-b03d-43ab-b52a-9987c1b6151d"}]}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:49.746054 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.network.neutron [None req-3f0f03ad-d45a-4479-8035-067a27e8154c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] validate_networks() for [('b96d6b4c-b03d-43ab-b52a-9987c1b6151d', None, None, None, None, None)] {{(pid=123069) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 09:49:50.377926 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-3f0f03ad-d45a-4479-8035-067a27e8154c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Flavor limits 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:49:50.377926 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-3f0f03ad-d45a-4479-8035-067a27e8154c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Image limits 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:49:50.377926 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-3f0f03ad-d45a-4479-8035-067a27e8154c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Flavor pref 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:49:50.377926 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-3f0f03ad-d45a-4479-8035-067a27e8154c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Image pref 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:49:50.377926 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-3f0f03ad-d45a-4479-8035-067a27e8154c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:49:50.381347 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-ac69856f-4751-4e5f-bf4d-1479e0a15b12 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:50.382423 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-ac69856f-4751-4e5f-bf4d-1479e0a15b12 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:50.385487 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3f0f03ad-d45a-4479-8035-067a27e8154c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:50.385487 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3f0f03ad-d45a-4479-8035-067a27e8154c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:50.387939 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3f0f03ad-d45a-4479-8035-067a27e8154c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:50.388532 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3f0f03ad-d45a-4479-8035-067a27e8154c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:50.398854 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ac69856f-4751-4e5f-bf4d-1479e0a15b12 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:50.399515 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ac69856f-4751-4e5f-bf4d-1479e0a15b12 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:50.400584 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ac69856f-4751-4e5f-bf4d-1479e0a15b12 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:50.401144 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ac69856f-4751-4e5f-bf4d-1479e0a15b12 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:50.419461 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.quota [None req-3f0f03ad-d45a-4479-8035-067a27e8154c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Getting quotas for project d8b63299da71443297d36c7caabb111a. Resources: {'ram', 'cores', 'instances'} {{(pid=123069) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 09:49:50.429040 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.quota [None req-3f0f03ad-d45a-4479-8035-067a27e8154c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Getting quotas for user ed1d061616e34ae18c84197e88a79108 and project d8b63299da71443297d36c7caabb111a. Resources: {'ram', 'cores', 'instances'} {{(pid=123069) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 09:49:50.443720 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-3f0f03ad-d45a-4479-8035-067a27e8154c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Going to run 1 instances... {{(pid=123069) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 09:49:50.446970 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-3f0f03ad-d45a-4479-8035-067a27e8154c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='623b30fc-1d92-46d9-b556-b9b963f3d76c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 09:49:50.658185 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-3f0f03ad-d45a-4479-8035-067a27e8154c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 1.289630 Oct 28 09:49:50.659343 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 71/146] 10.222.0.104 () {60 vars in 1151 bytes} [Thu Oct 28 09:49:49 2021] POST /compute/v2.1/servers => generated 385 bytes in 1294 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 28 09:49:50.666903 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-4c1024ee-9930-4e31-bc34-ec5b375da2a3 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:50.668372 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-4c1024ee-9930-4e31-bc34-ec5b375da2a3 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:50.679067 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4c1024ee-9930-4e31-bc34-ec5b375da2a3 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:50.679067 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4c1024ee-9930-4e31-bc34-ec5b375da2a3 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:50.679067 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4c1024ee-9930-4e31-bc34-ec5b375da2a3 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:50.679067 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4c1024ee-9930-4e31-bc34-ec5b375da2a3 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:52.463015 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-ac69856f-4751-4e5f-bf4d-1479e0a15b12 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 28209 microversion: 2.20 time: 2.087544 Oct 28 09:49:52.468559 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 76/147] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:49:50 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 28209 bytes in 2090 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:49:52.484302 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-d497fa0f-579f-45f6-a2cd-d1e23305f3b4 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:52.485277 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-d497fa0f-579f-45f6-a2cd-d1e23305f3b4 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:52.496854 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d497fa0f-579f-45f6-a2cd-d1e23305f3b4 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:52.496854 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d497fa0f-579f-45f6-a2cd-d1e23305f3b4 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:52.497824 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d497fa0f-579f-45f6-a2cd-d1e23305f3b4 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:52.498266 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d497fa0f-579f-45f6-a2cd-d1e23305f3b4 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:52.502486 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-4c1024ee-9930-4e31-bc34-ec5b375da2a3 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 200 len: 28602 microversion: 2.1 time: 1.841223 Oct 28 09:49:52.503627 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 72/148] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:49:50 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 28602 bytes in 1843 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:49:52.627251 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-d497fa0f-579f-45f6-a2cd-d1e23305f3b4 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:52.637603 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-d497fa0f-579f-45f6-a2cd-d1e23305f3b4 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1230 microversion: 2.1 time: 0.167681 Oct 28 09:49:52.638567 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 77/149] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:49:52 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1230 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:52.771918 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-5fa17d3e-0928-4c63-be03-20fecf12ca3d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-590620597", "imageRef": "623b30fc-1d92-46d9-b556-b9b963f3d76c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b96d6b4c-b03d-43ab-b52a-9987c1b6151d"}]}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:52.842756 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.network.neutron [None req-5fa17d3e-0928-4c63-be03-20fecf12ca3d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] validate_networks() for [('b96d6b4c-b03d-43ab-b52a-9987c1b6151d', None, None, None, None, None)] {{(pid=123069) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 09:49:53.349261 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-5fa17d3e-0928-4c63-be03-20fecf12ca3d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Flavor limits 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:49:53.350398 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-5fa17d3e-0928-4c63-be03-20fecf12ca3d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Image limits 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:49:53.351177 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-5fa17d3e-0928-4c63-be03-20fecf12ca3d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Flavor pref 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:49:53.351687 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-5fa17d3e-0928-4c63-be03-20fecf12ca3d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Image pref 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:49:53.353198 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-5fa17d3e-0928-4c63-be03-20fecf12ca3d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:49:53.365182 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5fa17d3e-0928-4c63-be03-20fecf12ca3d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:53.365872 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5fa17d3e-0928-4c63-be03-20fecf12ca3d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:53.366829 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5fa17d3e-0928-4c63-be03-20fecf12ca3d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:53.367410 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5fa17d3e-0928-4c63-be03-20fecf12ca3d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:53.389713 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.quota [None req-5fa17d3e-0928-4c63-be03-20fecf12ca3d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Getting quotas for project d8b63299da71443297d36c7caabb111a. Resources: {'ram', 'cores', 'instances'} {{(pid=123069) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 09:49:53.397853 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.quota [None req-5fa17d3e-0928-4c63-be03-20fecf12ca3d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Getting quotas for user ed1d061616e34ae18c84197e88a79108 and project d8b63299da71443297d36c7caabb111a. Resources: {'ram', 'cores', 'instances'} {{(pid=123069) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 09:49:53.409831 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-5fa17d3e-0928-4c63-be03-20fecf12ca3d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Going to run 1 instances... {{(pid=123069) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 09:49:53.412263 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-5fa17d3e-0928-4c63-be03-20fecf12ca3d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='623b30fc-1d92-46d9-b556-b9b963f3d76c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 09:49:53.475394 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-d07d46df-3876-462f-a20f-98dd1bd86708 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:53.476377 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-d07d46df-3876-462f-a20f-98dd1bd86708 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:53.483756 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d07d46df-3876-462f-a20f-98dd1bd86708 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:53.484184 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d07d46df-3876-462f-a20f-98dd1bd86708 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:53.484996 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d07d46df-3876-462f-a20f-98dd1bd86708 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:53.485652 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d07d46df-3876-462f-a20f-98dd1bd86708 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:53.572266 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-d07d46df-3876-462f-a20f-98dd1bd86708 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 28499 microversion: 2.20 time: 0.097552 Oct 28 09:49:53.574932 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 78/150] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:49:53 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 28499 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:49:53.580137 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-5fa17d3e-0928-4c63-be03-20fecf12ca3d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 0.815217 Oct 28 09:49:53.582560 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-07b57610-ef7a-4909-8394-0eb60a43e3ee tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:53.583278 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 73/151] 10.222.0.104 () {60 vars in 1151 bytes} [Thu Oct 28 09:49:52 2021] POST /compute/v2.1/servers => generated 385 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 28 09:49:53.589202 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-07b57610-ef7a-4909-8394-0eb60a43e3ee tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:53.594293 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-76c65d47-2161-42d2-bcc8-d98b1ea366c7 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:53.599116 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-76c65d47-2161-42d2-bcc8-d98b1ea366c7 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:53.599600 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-07b57610-ef7a-4909-8394-0eb60a43e3ee tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:53.599600 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-07b57610-ef7a-4909-8394-0eb60a43e3ee tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:53.600641 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-07b57610-ef7a-4909-8394-0eb60a43e3ee tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:53.601285 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-07b57610-ef7a-4909-8394-0eb60a43e3ee tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:53.665828 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-76c65d47-2161-42d2-bcc8-d98b1ea366c7 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:53.678303 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-76c65d47-2161-42d2-bcc8-d98b1ea366c7 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1225 microversion: 2.1 time: 0.088761 Oct 28 09:49:53.679208 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 74/152] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:49:53 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:49:53.752780 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-07b57610-ef7a-4909-8394-0eb60a43e3ee tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.175339 Oct 28 09:49:53.753744 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 79/153] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:49:53 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 28602 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:49:54.582335 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-48b1029b-a5b4-4349-9c88-ed7ed0aedcdd tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:54.584452 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-48b1029b-a5b4-4349-9c88-ed7ed0aedcdd tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:54.597236 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-48b1029b-a5b4-4349-9c88-ed7ed0aedcdd tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:54.597812 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-48b1029b-a5b4-4349-9c88-ed7ed0aedcdd tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:54.598777 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-48b1029b-a5b4-4349-9c88-ed7ed0aedcdd tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:54.599345 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-48b1029b-a5b4-4349-9c88-ed7ed0aedcdd tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:54.704839 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-63689902-d058-4bfa-8341-6d9d4a5d5510 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:54.704839 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-63689902-d058-4bfa-8341-6d9d4a5d5510 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:54.706537 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-48b1029b-a5b4-4349-9c88-ed7ed0aedcdd tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 28667 microversion: 2.20 time: 0.122997 Oct 28 09:49:54.714285 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 75/154] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:49:54 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 28667 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:49:54.767559 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-256e44c2-f620-48fa-b7c8-2955428ae2f2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:54.775379 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-256e44c2-f620-48fa-b7c8-2955428ae2f2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:54.802002 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-256e44c2-f620-48fa-b7c8-2955428ae2f2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:54.802481 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-256e44c2-f620-48fa-b7c8-2955428ae2f2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:54.803381 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-256e44c2-f620-48fa-b7c8-2955428ae2f2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:54.803888 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-256e44c2-f620-48fa-b7c8-2955428ae2f2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:54.823760 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-63689902-d058-4bfa-8341-6d9d4a5d5510 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:54.836522 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-63689902-d058-4bfa-8341-6d9d4a5d5510 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1225 microversion: 2.1 time: 0.143022 Oct 28 09:49:54.837703 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 80/155] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:49:54 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1225 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:49:54.942231 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-256e44c2-f620-48fa-b7c8-2955428ae2f2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 200 len: 30011 microversion: 2.1 time: 0.178843 Oct 28 09:49:54.943827 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 76/156] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:49:54 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 30011 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:49:55.730718 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-057f4f50-c8a5-485d-98a8-cabf36bfe42b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:55.730718 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-057f4f50-c8a5-485d-98a8-cabf36bfe42b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:55.736935 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-057f4f50-c8a5-485d-98a8-cabf36bfe42b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:55.737564 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-057f4f50-c8a5-485d-98a8-cabf36bfe42b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:55.740324 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-057f4f50-c8a5-485d-98a8-cabf36bfe42b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:55.740324 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-057f4f50-c8a5-485d-98a8-cabf36bfe42b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:55.821932 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-057f4f50-c8a5-485d-98a8-cabf36bfe42b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 28667 microversion: 2.20 time: 0.097442 Oct 28 09:49:55.829864 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 81/157] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:49:55 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 28667 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:49:55.859696 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-8e393aba-8983-4e14-b2d0-8c7a2ad211d3 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:55.860585 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-8e393aba-8983-4e14-b2d0-8c7a2ad211d3 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:55.869656 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8e393aba-8983-4e14-b2d0-8c7a2ad211d3 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:55.876386 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8e393aba-8983-4e14-b2d0-8c7a2ad211d3 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:55.876386 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8e393aba-8983-4e14-b2d0-8c7a2ad211d3 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:55.876386 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8e393aba-8983-4e14-b2d0-8c7a2ad211d3 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:55.955917 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-96ad513f-1cc6-4e91-98b9-ef0566a7faec tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:55.956894 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-96ad513f-1cc6-4e91-98b9-ef0566a7faec tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:55.966227 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-96ad513f-1cc6-4e91-98b9-ef0566a7faec tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:55.966679 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-96ad513f-1cc6-4e91-98b9-ef0566a7faec tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:55.967490 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-96ad513f-1cc6-4e91-98b9-ef0566a7faec tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:55.967923 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-96ad513f-1cc6-4e91-98b9-ef0566a7faec tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:55.986134 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-8e393aba-8983-4e14-b2d0-8c7a2ad211d3 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:55.994160 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-8e393aba-8983-4e14-b2d0-8c7a2ad211d3 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1221 microversion: 2.1 time: 0.139486 Oct 28 09:49:55.995245 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 77/158] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:49:55 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1221 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:56.068788 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-96ad513f-1cc6-4e91-98b9-ef0566a7faec tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 200 len: 31566 microversion: 2.1 time: 0.117624 Oct 28 09:49:56.077785 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 82/159] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:49:55 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 31566 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 09:49:56.848401 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-ccb921c0-6823-4bf3-b337-c0a7a3ab2dd2 req-fe7711b0-ca93-4858-ae2b-51f0ac021068 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a9b7bca-6189-4a5d-a9cb-ea0af980d95f", "tag": "2727ba0b-5ab2-4e16-98f8-42105ba1b2ba"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:56.849833 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-bcdd3eda-4702-4cad-a26c-2e23b395873f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:56.851061 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-bcdd3eda-4702-4cad-a26c-2e23b395873f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:56.851438 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:49:56.851438 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:49:56.860457 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bcdd3eda-4702-4cad-a26c-2e23b395873f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:56.861702 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bcdd3eda-4702-4cad-a26c-2e23b395873f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:56.862502 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bcdd3eda-4702-4cad-a26c-2e23b395873f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:56.863079 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bcdd3eda-4702-4cad-a26c-2e23b395873f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:56.878968 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-ccb921c0-6823-4bf3-b337-c0a7a3ab2dd2 req-fe7711b0-ca93-4858-ae2b-51f0ac021068 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:56.882627 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-ccb921c0-6823-4bf3-b337-c0a7a3ab2dd2 req-fe7711b0-ca93-4858-ae2b-51f0ac021068 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:56.909247 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-ccb921c0-6823-4bf3-b337-c0a7a3ab2dd2 req-fe7711b0-ca93-4858-ae2b-51f0ac021068 service nova] Creating event network-changed:2727ba0b-5ab2-4e16-98f8-42105ba1b2ba for instance 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f on hv-cinder-81571 Oct 28 09:49:56.916527 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-ccb921c0-6823-4bf3-b337-c0a7a3ab2dd2 req-fe7711b0-ca93-4858-ae2b-51f0ac021068 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073691 Oct 28 09:49:56.917908 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 83/160] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:49:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:49:56.958664 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-bcdd3eda-4702-4cad-a26c-2e23b395873f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 28667 microversion: 2.20 time: 0.122429 Oct 28 09:49:56.959662 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 78/161] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:49:56 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 28667 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:49:57.024543 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-0aadd610-f4a5-4a5a-9074-0a83c7eb2484 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:57.025794 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-0aadd610-f4a5-4a5a-9074-0a83c7eb2484 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:57.039409 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0aadd610-f4a5-4a5a-9074-0a83c7eb2484 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:57.039409 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0aadd610-f4a5-4a5a-9074-0a83c7eb2484 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:57.040221 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0aadd610-f4a5-4a5a-9074-0a83c7eb2484 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:57.040937 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0aadd610-f4a5-4a5a-9074-0a83c7eb2484 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:57.093506 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-7c332417-d525-456b-9950-4e30b3d7572a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:57.101684 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-7c332417-d525-456b-9950-4e30b3d7572a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:57.153676 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7c332417-d525-456b-9950-4e30b3d7572a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:57.155799 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7c332417-d525-456b-9950-4e30b3d7572a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:57.160769 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7c332417-d525-456b-9950-4e30b3d7572a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:57.161426 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7c332417-d525-456b-9950-4e30b3d7572a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:57.251342 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-0aadd610-f4a5-4a5a-9074-0a83c7eb2484 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:57.271403 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-0aadd610-f4a5-4a5a-9074-0a83c7eb2484 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1285 microversion: 2.1 time: 0.252764 Oct 28 09:49:57.273898 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 84/162] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:49:57 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1285 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:57.330246 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-7c332417-d525-456b-9950-4e30b3d7572a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 200 len: 32659 microversion: 2.1 time: 0.245004 Oct 28 09:49:57.331853 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 79/163] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:49:57 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 32659 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 09:49:57.972218 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-ed2eea9e-6a90-479d-ae43-81cd22357ccb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:57.973771 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-ed2eea9e-6a90-479d-ae43-81cd22357ccb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:57.981051 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ed2eea9e-6a90-479d-ae43-81cd22357ccb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:57.981872 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ed2eea9e-6a90-479d-ae43-81cd22357ccb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:57.982692 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ed2eea9e-6a90-479d-ae43-81cd22357ccb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:57.983297 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ed2eea9e-6a90-479d-ae43-81cd22357ccb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:58.065177 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-ed2eea9e-6a90-479d-ae43-81cd22357ccb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 28667 microversion: 2.20 time: 0.096202 Oct 28 09:49:58.071651 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 85/164] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:49:57 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 28667 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:49:58.291920 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-3f10ff22-1f8c-46ee-9f16-fb5c00b1a333 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:49:58.292716 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-3f10ff22-1f8c-46ee-9f16-fb5c00b1a333 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:58.300401 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3f10ff22-1f8c-46ee-9f16-fb5c00b1a333 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:58.300890 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3f10ff22-1f8c-46ee-9f16-fb5c00b1a333 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:58.301705 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3f10ff22-1f8c-46ee-9f16-fb5c00b1a333 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:58.302251 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3f10ff22-1f8c-46ee-9f16-fb5c00b1a333 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:58.355012 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-3cb170c8-28a3-41c9-ac4d-2667c6d7a657 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:58.363968 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-3cb170c8-28a3-41c9-ac4d-2667c6d7a657 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:58.377523 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3cb170c8-28a3-41c9-ac4d-2667c6d7a657 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:58.378222 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3cb170c8-28a3-41c9-ac4d-2667c6d7a657 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:58.379538 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3cb170c8-28a3-41c9-ac4d-2667c6d7a657 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:58.380164 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3cb170c8-28a3-41c9-ac4d-2667c6d7a657 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:58.474482 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-3cb170c8-28a3-41c9-ac4d-2667c6d7a657 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 200 len: 33360 microversion: 2.1 time: 0.133089 Oct 28 09:49:58.475620 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 86/165] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:49:58 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 33360 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:49:58.611426 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-3f10ff22-1f8c-46ee-9f16-fb5c00b1a333 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:49:58.619754 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-3f10ff22-1f8c-46ee-9f16-fb5c00b1a333 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1325 microversion: 2.1 time: 0.331875 Oct 28 09:49:58.623305 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 80/166] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:49:58 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1325 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:49:59.083142 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-2102cd75-1d69-444d-a46c-4644f2d5370e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:59.084872 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-2102cd75-1d69-444d-a46c-4644f2d5370e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:59.095971 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2102cd75-1d69-444d-a46c-4644f2d5370e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:59.096776 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2102cd75-1d69-444d-a46c-4644f2d5370e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:59.098149 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2102cd75-1d69-444d-a46c-4644f2d5370e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:59.098907 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2102cd75-1d69-444d-a46c-4644f2d5370e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:59.488695 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-ccce76d1-92de-498c-87c1-a140d0c3a923 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:49:59.489699 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-ccce76d1-92de-498c-87c1-a140d0c3a923 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:49:59.499738 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ccce76d1-92de-498c-87c1-a140d0c3a923 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:59.500248 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ccce76d1-92de-498c-87c1-a140d0c3a923 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:49:59.501140 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ccce76d1-92de-498c-87c1-a140d0c3a923 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:49:59.501822 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ccce76d1-92de-498c-87c1-a140d0c3a923 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:01.311349 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-2102cd75-1d69-444d-a46c-4644f2d5370e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 28667 microversion: 2.20 time: 2.235943 Oct 28 09:50:01.313817 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 87/167] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:49:59 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 28667 bytes in 2238 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 09:50:01.314614 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-ccce76d1-92de-498c-87c1-a140d0c3a923 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 200 len: 36435 microversion: 2.1 time: 1.822356 Oct 28 09:50:01.315405 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 81/168] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:49:59 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 36435 bytes in 1832 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 09:50:01.320869 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-fc6d7057-c827-48d3-8639-323f1eac2026 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:01.322398 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-fc6d7057-c827-48d3-8639-323f1eac2026 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:01.334764 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fc6d7057-c827-48d3-8639-323f1eac2026 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:01.335190 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fc6d7057-c827-48d3-8639-323f1eac2026 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:01.336162 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fc6d7057-c827-48d3-8639-323f1eac2026 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:01.336605 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fc6d7057-c827-48d3-8639-323f1eac2026 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:01.634914 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-fc6d7057-c827-48d3-8639-323f1eac2026 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:01.645365 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-fc6d7057-c827-48d3-8639-323f1eac2026 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1325 microversion: 2.1 time: 0.331942 Oct 28 09:50:01.645947 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 88/169] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:01 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1325 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:02.326970 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-fdb04b13-3a36-47d4-bc51-a1405bf5b4c5 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:02.327954 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-fdb04b13-3a36-47d4-bc51-a1405bf5b4c5 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:02.339927 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fdb04b13-3a36-47d4-bc51-a1405bf5b4c5 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:02.340399 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fdb04b13-3a36-47d4-bc51-a1405bf5b4c5 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:02.341201 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fdb04b13-3a36-47d4-bc51-a1405bf5b4c5 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:02.341655 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fdb04b13-3a36-47d4-bc51-a1405bf5b4c5 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:02.342537 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-57fe6eca-aae9-4f7c-9a88-0b3a1e40715a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:02.344225 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-57fe6eca-aae9-4f7c-9a88-0b3a1e40715a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:02.366113 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-57fe6eca-aae9-4f7c-9a88-0b3a1e40715a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:02.366713 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-57fe6eca-aae9-4f7c-9a88-0b3a1e40715a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:02.367923 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-57fe6eca-aae9-4f7c-9a88-0b3a1e40715a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:02.368499 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-57fe6eca-aae9-4f7c-9a88-0b3a1e40715a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:02.437088 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-fdb04b13-3a36-47d4-bc51-a1405bf5b4c5 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 200 len: 37135 microversion: 2.1 time: 0.112788 Oct 28 09:50:02.445945 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 89/170] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:50:02 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 37135 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 09:50:02.473741 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-57fe6eca-aae9-4f7c-9a88-0b3a1e40715a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 28667 microversion: 2.20 time: 0.152845 Oct 28 09:50:02.474373 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 82/171] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:50:02 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 28667 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:50:02.524372 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-00f9d5f2-0e60-4e63-a96d-411e953d59d7 req-ef4ede5d-637e-41df-9435-50dbab1a1dee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92c11d42-a056-41fa-a849-4e40e7c6d22e", "tag": "57d63798-5c66-4f30-9d4a-de7a6ff1392d"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:02.524372 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:50:02.524372 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:50:02.544397 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-00f9d5f2-0e60-4e63-a96d-411e953d59d7 req-ef4ede5d-637e-41df-9435-50dbab1a1dee service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:02.549422 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-00f9d5f2-0e60-4e63-a96d-411e953d59d7 req-ef4ede5d-637e-41df-9435-50dbab1a1dee service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:02.564892 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-00f9d5f2-0e60-4e63-a96d-411e953d59d7 req-ef4ede5d-637e-41df-9435-50dbab1a1dee service nova] Creating event network-changed:57d63798-5c66-4f30-9d4a-de7a6ff1392d for instance 92c11d42-a056-41fa-a849-4e40e7c6d22e on hv-cinder-81571 Oct 28 09:50:02.569759 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-00f9d5f2-0e60-4e63-a96d-411e953d59d7 req-ef4ede5d-637e-41df-9435-50dbab1a1dee service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075814 Oct 28 09:50:02.570279 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 90/172] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:50:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:02.663870 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-0ccbf38e-ab3b-4a3e-991e-7fee19959355 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:02.664574 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-0ccbf38e-ab3b-4a3e-991e-7fee19959355 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:02.672778 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0ccbf38e-ab3b-4a3e-991e-7fee19959355 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:02.673158 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0ccbf38e-ab3b-4a3e-991e-7fee19959355 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:02.673962 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0ccbf38e-ab3b-4a3e-991e-7fee19959355 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:02.674392 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0ccbf38e-ab3b-4a3e-991e-7fee19959355 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:03.003047 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-0ccbf38e-ab3b-4a3e-991e-7fee19959355 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:03.014635 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-0ccbf38e-ab3b-4a3e-991e-7fee19959355 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1325 microversion: 2.1 time: 0.353938 Oct 28 09:50:03.025602 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 83/173] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:02 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1325 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:03.456021 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-a448b071-4caa-49c0-83ae-dfa12646f72c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:03.457716 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-a448b071-4caa-49c0-83ae-dfa12646f72c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:03.471227 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a448b071-4caa-49c0-83ae-dfa12646f72c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:03.471681 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a448b071-4caa-49c0-83ae-dfa12646f72c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:03.473753 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a448b071-4caa-49c0-83ae-dfa12646f72c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:03.474193 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a448b071-4caa-49c0-83ae-dfa12646f72c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:03.491232 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-300a27d5-14e5-4a1c-a7db-f599ef922739 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:03.491232 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-300a27d5-14e5-4a1c-a7db-f599ef922739 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:03.498097 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-300a27d5-14e5-4a1c-a7db-f599ef922739 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:03.501211 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-300a27d5-14e5-4a1c-a7db-f599ef922739 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:03.502107 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-300a27d5-14e5-4a1c-a7db-f599ef922739 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:03.502541 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-300a27d5-14e5-4a1c-a7db-f599ef922739 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:03.587727 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-300a27d5-14e5-4a1c-a7db-f599ef922739 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 29215 microversion: 2.20 time: 0.103925 Oct 28 09:50:03.588431 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 84/174] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:50:03 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 29215 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 09:50:03.617279 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-a448b071-4caa-49c0-83ae-dfa12646f72c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 200 len: 38129 microversion: 2.1 time: 0.168442 Oct 28 09:50:03.618742 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 91/175] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:50:03 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 38129 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:50:04.045927 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-86c0e5b4-3436-4503-9d3b-3c36f109b2aa tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:04.047237 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-86c0e5b4-3436-4503-9d3b-3c36f109b2aa tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:04.100312 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-86c0e5b4-3436-4503-9d3b-3c36f109b2aa tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:04.101241 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-86c0e5b4-3436-4503-9d3b-3c36f109b2aa tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:04.102544 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-86c0e5b4-3436-4503-9d3b-3c36f109b2aa tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:04.111181 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-86c0e5b4-3436-4503-9d3b-3c36f109b2aa tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:04.430731 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-86c0e5b4-3436-4503-9d3b-3c36f109b2aa tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:04.468098 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-86c0e5b4-3436-4503-9d3b-3c36f109b2aa tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1325 microversion: 2.1 time: 0.439039 Oct 28 09:50:04.468709 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 85/176] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:04 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1325 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:04.600198 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-d58a1e29-7bbb-40b3-946c-a12604b7a8b1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:04.601294 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-d58a1e29-7bbb-40b3-946c-a12604b7a8b1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:04.617496 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d58a1e29-7bbb-40b3-946c-a12604b7a8b1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:04.617496 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d58a1e29-7bbb-40b3-946c-a12604b7a8b1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:04.617496 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d58a1e29-7bbb-40b3-946c-a12604b7a8b1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:04.617496 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d58a1e29-7bbb-40b3-946c-a12604b7a8b1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:04.633044 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-bbf6d9b6-9797-49c2-993f-e7568c85415f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:04.634529 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-bbf6d9b6-9797-49c2-993f-e7568c85415f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:04.643143 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bbf6d9b6-9797-49c2-993f-e7568c85415f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:04.643809 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bbf6d9b6-9797-49c2-993f-e7568c85415f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:04.651252 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bbf6d9b6-9797-49c2-993f-e7568c85415f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:04.651252 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bbf6d9b6-9797-49c2-993f-e7568c85415f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:04.762945 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-d58a1e29-7bbb-40b3-946c-a12604b7a8b1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 30704 microversion: 2.20 time: 0.166389 Oct 28 09:50:04.776152 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 92/177] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:50:04 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 30704 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:50:04.778419 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-bbf6d9b6-9797-49c2-993f-e7568c85415f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 200 len: 38129 microversion: 2.1 time: 0.148954 Oct 28 09:50:04.784469 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 86/178] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:50:04 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 38129 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 09:50:05.487867 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-c4e41462-3c5d-4992-aa93-e38427f9f744 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:05.489262 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-c4e41462-3c5d-4992-aa93-e38427f9f744 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:05.503933 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c4e41462-3c5d-4992-aa93-e38427f9f744 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:05.505096 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c4e41462-3c5d-4992-aa93-e38427f9f744 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:05.506502 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c4e41462-3c5d-4992-aa93-e38427f9f744 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:05.507101 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c4e41462-3c5d-4992-aa93-e38427f9f744 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:05.695195 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-c4e41462-3c5d-4992-aa93-e38427f9f744 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:05.704534 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-c4e41462-3c5d-4992-aa93-e38427f9f744 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1325 microversion: 2.1 time: 0.223209 Oct 28 09:50:05.705538 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 93/179] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:05 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1325 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:05.793834 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-7540724f-9525-4b18-9339-2a4e30766153 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:05.793834 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-7540724f-9525-4b18-9339-2a4e30766153 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:05.802247 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-37a27a35-26d8-42e2-87b0-3a41eb1b379d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:05.805466 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-37a27a35-26d8-42e2-87b0-3a41eb1b379d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:05.810042 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7540724f-9525-4b18-9339-2a4e30766153 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:05.810682 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7540724f-9525-4b18-9339-2a4e30766153 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:05.813512 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7540724f-9525-4b18-9339-2a4e30766153 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:05.815454 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7540724f-9525-4b18-9339-2a4e30766153 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:05.828342 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-37a27a35-26d8-42e2-87b0-3a41eb1b379d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:05.830076 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-37a27a35-26d8-42e2-87b0-3a41eb1b379d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:05.831129 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-37a27a35-26d8-42e2-87b0-3a41eb1b379d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:05.833962 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-37a27a35-26d8-42e2-87b0-3a41eb1b379d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:05.943326 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-37a27a35-26d8-42e2-87b0-3a41eb1b379d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 32303 microversion: 2.20 time: 0.161623 Oct 28 09:50:05.945412 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 87/180] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:50:05 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 32303 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:50:05.951734 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-7540724f-9525-4b18-9339-2a4e30766153 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 200 len: 38129 microversion: 2.1 time: 0.159111 Oct 28 09:50:05.951734 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 94/181] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:50:05 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 38129 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:50:06.452472 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [req-022f7f06-667b-40b2-b213-39d843155d99 req-94ad8e3d-9c3b-430b-ac04-2032c3cb3374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a9b7bca-6189-4a5d-a9cb-ea0af980d95f", "name": "network-vif-plugged", "status": "completed", "tag": "2727ba0b-5ab2-4e16-98f8-42105ba1b2ba"}]} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:06.454105 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:50:06.454105 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 09:50:06.464975 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-022f7f06-667b-40b2-b213-39d843155d99 req-94ad8e3d-9c3b-430b-ac04-2032c3cb3374 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:06.478960 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-022f7f06-667b-40b2-b213-39d843155d99 req-94ad8e3d-9c3b-430b-ac04-2032c3cb3374 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:06.478960 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.compute.server_external_events [req-022f7f06-667b-40b2-b213-39d843155d99 req-94ad8e3d-9c3b-430b-ac04-2032c3cb3374 service nova] Creating event network-vif-plugged:2727ba0b-5ab2-4e16-98f8-42105ba1b2ba for instance 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f on hv-cinder-81571 Oct 28 09:50:06.482722 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [req-022f7f06-667b-40b2-b213-39d843155d99 req-94ad8e3d-9c3b-430b-ac04-2032c3cb3374 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036166 Oct 28 09:50:06.483736 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 88/182] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:50:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:06.722451 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-a6c7a04f-29ee-4f4c-8eb0-0e6f466941a4 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:06.723167 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-a6c7a04f-29ee-4f4c-8eb0-0e6f466941a4 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:06.730844 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a6c7a04f-29ee-4f4c-8eb0-0e6f466941a4 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:06.731553 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a6c7a04f-29ee-4f4c-8eb0-0e6f466941a4 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:06.732421 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a6c7a04f-29ee-4f4c-8eb0-0e6f466941a4 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:06.733019 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a6c7a04f-29ee-4f4c-8eb0-0e6f466941a4 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:06.961359 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-b997d5bc-1cf4-44ad-8aab-919dbbcaa34c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:06.966152 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-b997d5bc-1cf4-44ad-8aab-919dbbcaa34c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:06.974221 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b997d5bc-1cf4-44ad-8aab-919dbbcaa34c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:06.974666 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b997d5bc-1cf4-44ad-8aab-919dbbcaa34c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:06.975441 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b997d5bc-1cf4-44ad-8aab-919dbbcaa34c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:06.976041 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b997d5bc-1cf4-44ad-8aab-919dbbcaa34c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:07.023495 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-a6c7a04f-29ee-4f4c-8eb0-0e6f466941a4 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:07.035497 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-a6c7a04f-29ee-4f4c-8eb0-0e6f466941a4 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1325 microversion: 2.1 time: 0.316549 Oct 28 09:50:07.036370 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 95/183] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:06 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1325 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:07.043301 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-9873c4be-514a-43e2-a084-cb52af986c27 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:07.044095 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-9873c4be-514a-43e2-a084-cb52af986c27 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:07.050425 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9873c4be-514a-43e2-a084-cb52af986c27 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:07.050862 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9873c4be-514a-43e2-a084-cb52af986c27 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:07.051809 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9873c4be-514a-43e2-a084-cb52af986c27 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:07.052234 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9873c4be-514a-43e2-a084-cb52af986c27 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:07.303571 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-b997d5bc-1cf4-44ad-8aab-919dbbcaa34c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 33268 microversion: 2.20 time: 0.350809 Oct 28 09:50:07.304307 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 89/184] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:50:06 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 33268 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:50:07.353826 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-9873c4be-514a-43e2-a084-cb52af986c27 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 200 len: 38258 microversion: 2.1 time: 0.315556 Oct 28 09:50:07.354802 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 96/185] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:50:07 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 38258 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:50:07.366967 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-dcf32b86-907d-4b44-abdc-e91a7b333305 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:07.367534 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-dcf32b86-907d-4b44-abdc-e91a7b333305 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:07.375766 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-dcf32b86-907d-4b44-abdc-e91a7b333305 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:07.376685 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-dcf32b86-907d-4b44-abdc-e91a7b333305 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:07.377530 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-dcf32b86-907d-4b44-abdc-e91a7b333305 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:07.378188 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-dcf32b86-907d-4b44-abdc-e91a7b333305 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:07.408333 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-dcf32b86-907d-4b44-abdc-e91a7b333305 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/ips" status: 200 len: 146 microversion: 2.1 time: 0.045904 Oct 28 09:50:07.408930 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 90/186] 10.222.0.104 () {58 vars in 1252 bytes} [Thu Oct 28 09:50:07 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/ips => generated 146 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:50:08.055600 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-61402658-ac4f-423a-8e27-8cac53c2d821 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:08.058208 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-61402658-ac4f-423a-8e27-8cac53c2d821 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:08.068374 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-61402658-ac4f-423a-8e27-8cac53c2d821 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:08.069610 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-61402658-ac4f-423a-8e27-8cac53c2d821 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:08.071269 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-61402658-ac4f-423a-8e27-8cac53c2d821 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:08.071725 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-61402658-ac4f-423a-8e27-8cac53c2d821 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:08.241196 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-61402658-ac4f-423a-8e27-8cac53c2d821 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:08.249935 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-61402658-ac4f-423a-8e27-8cac53c2d821 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1325 microversion: 2.1 time: 0.198323 Oct 28 09:50:08.256796 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 97/187] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:08 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1325 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:08.316400 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-18db56da-7aa4-4073-9ee9-92e757571a05 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:08.318234 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-18db56da-7aa4-4073-9ee9-92e757571a05 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:08.325341 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-18db56da-7aa4-4073-9ee9-92e757571a05 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:08.326029 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-18db56da-7aa4-4073-9ee9-92e757571a05 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:08.327050 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-18db56da-7aa4-4073-9ee9-92e757571a05 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:08.327688 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-18db56da-7aa4-4073-9ee9-92e757571a05 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:08.437911 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-18db56da-7aa4-4073-9ee9-92e757571a05 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 33486 microversion: 2.20 time: 0.125649 Oct 28 09:50:08.438927 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 91/188] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:50:08 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 33486 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:50:08.521488 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-c6c797b0-3399-496e-8a78-ecc6abb1e48a req-1a78309a-f10d-4b9c-bc9a-0b8b44a084ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92c11d42-a056-41fa-a849-4e40e7c6d22e", "name": "network-vif-plugged", "status": "completed", "tag": "57d63798-5c66-4f30-9d4a-de7a6ff1392d"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:08.524431 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:50:08.524431 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:50:08.538141 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-c6c797b0-3399-496e-8a78-ecc6abb1e48a req-1a78309a-f10d-4b9c-bc9a-0b8b44a084ab service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:08.539295 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-c6c797b0-3399-496e-8a78-ecc6abb1e48a req-1a78309a-f10d-4b9c-bc9a-0b8b44a084ab service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:08.576500 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-c6c797b0-3399-496e-8a78-ecc6abb1e48a req-1a78309a-f10d-4b9c-bc9a-0b8b44a084ab service nova] Creating event network-vif-plugged:57d63798-5c66-4f30-9d4a-de7a6ff1392d for instance 92c11d42-a056-41fa-a849-4e40e7c6d22e on hv-cinder-81571 Oct 28 09:50:08.591076 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-c6c797b0-3399-496e-8a78-ecc6abb1e48a req-1a78309a-f10d-4b9c-bc9a-0b8b44a084ab service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076573 Oct 28 09:50:08.592941 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 98/189] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:50:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:09.269659 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-4d3932b6-3e13-4a51-9a8f-c0a79c4ce696 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:09.270262 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-4d3932b6-3e13-4a51-9a8f-c0a79c4ce696 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:09.277271 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4d3932b6-3e13-4a51-9a8f-c0a79c4ce696 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:09.278250 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4d3932b6-3e13-4a51-9a8f-c0a79c4ce696 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:09.279042 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4d3932b6-3e13-4a51-9a8f-c0a79c4ce696 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:09.279471 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4d3932b6-3e13-4a51-9a8f-c0a79c4ce696 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:09.450825 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-113fb825-5ab8-47c6-8735-47afd7934502 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:09.453154 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-113fb825-5ab8-47c6-8735-47afd7934502 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:09.471743 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-113fb825-5ab8-47c6-8735-47afd7934502 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:09.471743 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-113fb825-5ab8-47c6-8735-47afd7934502 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:09.471743 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-113fb825-5ab8-47c6-8735-47afd7934502 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:09.471743 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-113fb825-5ab8-47c6-8735-47afd7934502 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:09.549804 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-113fb825-5ab8-47c6-8735-47afd7934502 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 34040 microversion: 2.20 time: 0.103431 Oct 28 09:50:09.554222 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 99/190] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:50:09 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 34040 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 09:50:09.804769 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-4d3932b6-3e13-4a51-9a8f-c0a79c4ce696 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:09.863865 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-4d3932b6-3e13-4a51-9a8f-c0a79c4ce696 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1325 microversion: 2.1 time: 0.591254 Oct 28 09:50:09.864837 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 92/191] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:09 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1325 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:10.563618 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-3d6a4c11-af00-4bd3-8c43-4dd304649dbd tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:10.569645 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-3d6a4c11-af00-4bd3-8c43-4dd304649dbd tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:10.595649 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3d6a4c11-af00-4bd3-8c43-4dd304649dbd tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:10.596370 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3d6a4c11-af00-4bd3-8c43-4dd304649dbd tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:10.597189 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3d6a4c11-af00-4bd3-8c43-4dd304649dbd tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:10.597617 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3d6a4c11-af00-4bd3-8c43-4dd304649dbd tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:10.690537 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-3d6a4c11-af00-4bd3-8c43-4dd304649dbd tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 34896 microversion: 2.20 time: 0.131279 Oct 28 09:50:10.691961 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 100/192] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:50:10 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 34896 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:50:10.882196 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-c5f76ae4-0fc7-477b-874c-18ae8552378a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:10.882804 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-c5f76ae4-0fc7-477b-874c-18ae8552378a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:10.891221 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c5f76ae4-0fc7-477b-874c-18ae8552378a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:10.891661 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c5f76ae4-0fc7-477b-874c-18ae8552378a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:10.892435 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c5f76ae4-0fc7-477b-874c-18ae8552378a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:10.892936 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c5f76ae4-0fc7-477b-874c-18ae8552378a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:11.248076 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-c5f76ae4-0fc7-477b-874c-18ae8552378a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:11.257876 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-c5f76ae4-0fc7-477b-874c-18ae8552378a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1325 microversion: 2.1 time: 0.379082 Oct 28 09:50:11.273946 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 93/193] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:10 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1325 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:11.356315 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-bc99b401-cae3-4ad8-8752-5e0e42050dd8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b26924ac-4675-44b2-9475-c1e2c042dc92"}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:11.358006 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-bc99b401-cae3-4ad8-8752-5e0e42050dd8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:11.366121 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bc99b401-cae3-4ad8-8752-5e0e42050dd8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:11.366977 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bc99b401-cae3-4ad8-8752-5e0e42050dd8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:11.368003 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bc99b401-cae3-4ad8-8752-5e0e42050dd8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:11.368617 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bc99b401-cae3-4ad8-8752-5e0e42050dd8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:11.704832 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-7b1b1a5d-00b6-4023-89a6-9ea9f9e23266 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:11.705792 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-7b1b1a5d-00b6-4023-89a6-9ea9f9e23266 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:11.712611 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7b1b1a5d-00b6-4023-89a6-9ea9f9e23266 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:11.713229 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7b1b1a5d-00b6-4023-89a6-9ea9f9e23266 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:11.714846 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7b1b1a5d-00b6-4023-89a6-9ea9f9e23266 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:11.715303 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7b1b1a5d-00b6-4023-89a6-9ea9f9e23266 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:11.837934 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-7b1b1a5d-00b6-4023-89a6-9ea9f9e23266 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 35403 microversion: 2.20 time: 0.137970 Oct 28 09:50:11.839578 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 94/194] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:50:11 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 35403 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:50:12.278454 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-2ee2021c-3930-4fa2-a2fd-ac97ef355639 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:12.279212 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-2ee2021c-3930-4fa2-a2fd-ac97ef355639 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:12.291750 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2ee2021c-3930-4fa2-a2fd-ac97ef355639 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:12.293487 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2ee2021c-3930-4fa2-a2fd-ac97ef355639 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:12.297615 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2ee2021c-3930-4fa2-a2fd-ac97ef355639 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:12.300234 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2ee2021c-3930-4fa2-a2fd-ac97ef355639 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:12.534705 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-2ee2021c-3930-4fa2-a2fd-ac97ef355639 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:12.550306 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-2ee2021c-3930-4fa2-a2fd-ac97ef355639 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1520 microversion: 2.1 time: 0.277080 Oct 28 09:50:12.551293 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 95/195] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:12 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1520 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:12.568053 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-1bc18e8b-cac8-44af-980f-140351f1639c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:12.570302 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-1bc18e8b-cac8-44af-980f-140351f1639c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:12.582023 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1bc18e8b-cac8-44af-980f-140351f1639c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:12.582731 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1bc18e8b-cac8-44af-980f-140351f1639c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:12.584237 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1bc18e8b-cac8-44af-980f-140351f1639c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:12.587031 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1bc18e8b-cac8-44af-980f-140351f1639c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:12.611857 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-bc99b401-cae3-4ad8-8752-5e0e42050dd8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.260315 Oct 28 09:50:12.625792 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 101/196] 10.222.0.104 () {60 vars in 1327 bytes} [Thu Oct 28 09:50:11 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/os-volume_attachments => generated 194 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:12.684102 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.objects.instance [None req-1bc18e8b-cac8-44af-980f-140351f1639c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lazy-loading 'flavor' on Instance uuid 92c11d42-a056-41fa-a849-4e40e7c6d22e {{(pid=123069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 09:50:12.851955 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-1ae37a2d-78b4-4da2-be70-23112133d97d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:12.853413 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-1ae37a2d-78b4-4da2-be70-23112133d97d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:12.869838 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1ae37a2d-78b4-4da2-be70-23112133d97d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:12.870455 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1ae37a2d-78b4-4da2-be70-23112133d97d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:12.871318 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1ae37a2d-78b4-4da2-be70-23112133d97d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:12.874053 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1ae37a2d-78b4-4da2-be70-23112133d97d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:13.017007 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-1ae37a2d-78b4-4da2-be70-23112133d97d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 36535 microversion: 2.20 time: 0.169066 Oct 28 09:50:13.018277 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 102/197] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:50:12 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 36535 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 09:50:13.310407 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-1bc18e8b-cac8-44af-980f-140351f1639c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "POST /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e/action" status: 200 len: 32 microversion: 2.1 time: 0.745881 Oct 28 09:50:13.312146 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 96/198] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:50:12 2021] POST /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e/action => generated 32 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:50:13.325560 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-1385d0c4-1f01-47dd-ae18-c377163b1076 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:13.326930 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-1385d0c4-1f01-47dd-ae18-c377163b1076 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:13.334927 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1385d0c4-1f01-47dd-ae18-c377163b1076 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:13.335683 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1385d0c4-1f01-47dd-ae18-c377163b1076 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:13.336698 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1385d0c4-1f01-47dd-ae18-c377163b1076 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:13.337299 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1385d0c4-1f01-47dd-ae18-c377163b1076 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:13.596126 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-1385d0c4-1f01-47dd-ae18-c377163b1076 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:13.604222 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-1385d0c4-1f01-47dd-ae18-c377163b1076 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1526 microversion: 2.1 time: 0.285907 Oct 28 09:50:13.607183 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 103/199] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:13 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1526 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:14.032513 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-1ce2a6e2-0c68-4fc2-8f19-9e8612db4f77 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:14.041384 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-1ce2a6e2-0c68-4fc2-8f19-9e8612db4f77 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:14.062245 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1ce2a6e2-0c68-4fc2-8f19-9e8612db4f77 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:14.062730 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1ce2a6e2-0c68-4fc2-8f19-9e8612db4f77 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:14.065473 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1ce2a6e2-0c68-4fc2-8f19-9e8612db4f77 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:14.065971 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1ce2a6e2-0c68-4fc2-8f19-9e8612db4f77 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:14.194021 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-1ce2a6e2-0c68-4fc2-8f19-9e8612db4f77 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 37591 microversion: 2.20 time: 0.167755 Oct 28 09:50:14.198854 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 97/200] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:50:14 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 37591 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:50:14.624799 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-0e7bd0d8-0e1f-44d5-beb5-f60e8cb5a773 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:14.625422 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-0e7bd0d8-0e1f-44d5-beb5-f60e8cb5a773 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:14.648232 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0e7bd0d8-0e1f-44d5-beb5-f60e8cb5a773 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:14.654210 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0e7bd0d8-0e1f-44d5-beb5-f60e8cb5a773 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:14.655347 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0e7bd0d8-0e1f-44d5-beb5-f60e8cb5a773 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:14.655799 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0e7bd0d8-0e1f-44d5-beb5-f60e8cb5a773 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:14.936637 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-0e7bd0d8-0e1f-44d5-beb5-f60e8cb5a773 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:14.948092 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-0e7bd0d8-0e1f-44d5-beb5-f60e8cb5a773 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1526 microversion: 2.1 time: 0.327905 Oct 28 09:50:14.949091 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 104/201] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:14 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1526 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:15.211312 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-7bd3030e-c854-44a7-9a29-9cc186c1f9e1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:15.213208 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-7bd3030e-c854-44a7-9a29-9cc186c1f9e1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:15.230233 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7bd3030e-c854-44a7-9a29-9cc186c1f9e1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:15.231824 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7bd3030e-c854-44a7-9a29-9cc186c1f9e1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:15.235771 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7bd3030e-c854-44a7-9a29-9cc186c1f9e1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:15.236455 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7bd3030e-c854-44a7-9a29-9cc186c1f9e1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:15.350689 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-7bd3030e-c854-44a7-9a29-9cc186c1f9e1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 38212 microversion: 2.20 time: 0.142523 Oct 28 09:50:15.351900 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 98/202] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:50:15 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 38212 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:50:15.973249 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-46cd836a-57aa-4ee4-93f1-66227f74e7d5 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:15.974065 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-46cd836a-57aa-4ee4-93f1-66227f74e7d5 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:15.980878 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-46cd836a-57aa-4ee4-93f1-66227f74e7d5 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:15.981357 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-46cd836a-57aa-4ee4-93f1-66227f74e7d5 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:15.982974 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-46cd836a-57aa-4ee4-93f1-66227f74e7d5 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:15.982974 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-46cd836a-57aa-4ee4-93f1-66227f74e7d5 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:16.139008 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-46cd836a-57aa-4ee4-93f1-66227f74e7d5 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:16.148164 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-46cd836a-57aa-4ee4-93f1-66227f74e7d5 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1526 microversion: 2.1 time: 0.178935 Oct 28 09:50:16.148804 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 105/203] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:15 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1526 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:16.376314 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-5c77b153-ced0-49f1-864a-f47a7a0c54ca tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:16.376314 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-5c77b153-ced0-49f1-864a-f47a7a0c54ca tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:16.379971 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5c77b153-ced0-49f1-864a-f47a7a0c54ca tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:16.380538 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5c77b153-ced0-49f1-864a-f47a7a0c54ca tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:16.381500 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5c77b153-ced0-49f1-864a-f47a7a0c54ca tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:16.381942 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5c77b153-ced0-49f1-864a-f47a7a0c54ca tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:16.526868 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-5c77b153-ced0-49f1-864a-f47a7a0c54ca tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 38212 microversion: 2.20 time: 0.163881 Oct 28 09:50:16.530944 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 99/204] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:50:16 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 38212 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:50:17.166727 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-fc32cbe7-146f-4ba2-9187-c9d31fd4ff8e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:17.167861 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-fc32cbe7-146f-4ba2-9187-c9d31fd4ff8e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:17.176035 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fc32cbe7-146f-4ba2-9187-c9d31fd4ff8e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:17.178781 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fc32cbe7-146f-4ba2-9187-c9d31fd4ff8e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:17.178781 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fc32cbe7-146f-4ba2-9187-c9d31fd4ff8e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:17.178781 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fc32cbe7-146f-4ba2-9187-c9d31fd4ff8e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:17.342341 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-fc32cbe7-146f-4ba2-9187-c9d31fd4ff8e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:17.358408 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-fc32cbe7-146f-4ba2-9187-c9d31fd4ff8e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1526 microversion: 2.1 time: 0.196015 Oct 28 09:50:17.359552 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 106/205] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:17 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1526 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:17.540449 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-019eafd2-24a6-47f8-873a-b908bfbb0e9c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:17.541615 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-019eafd2-24a6-47f8-873a-b908bfbb0e9c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:17.550756 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-019eafd2-24a6-47f8-873a-b908bfbb0e9c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:17.555723 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-019eafd2-24a6-47f8-873a-b908bfbb0e9c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:17.556562 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-019eafd2-24a6-47f8-873a-b908bfbb0e9c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:17.557027 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-019eafd2-24a6-47f8-873a-b908bfbb0e9c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:17.835987 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-019eafd2-24a6-47f8-873a-b908bfbb0e9c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 200 len: 38355 microversion: 2.20 time: 0.299585 Oct 28 09:50:17.836702 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 100/206] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:50:17 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 38355 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:50:17.847719 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-432b7804-6193-478f-bf9d-588204849718 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:17.848335 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-432b7804-6193-478f-bf9d-588204849718 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:17.854890 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-432b7804-6193-478f-bf9d-588204849718 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:17.856153 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-432b7804-6193-478f-bf9d-588204849718 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:17.856153 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-432b7804-6193-478f-bf9d-588204849718 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:17.856600 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-432b7804-6193-478f-bf9d-588204849718 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:17.883863 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-432b7804-6193-478f-bf9d-588204849718 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/ips" status: 200 len: 150 microversion: 2.20 time: 0.040094 Oct 28 09:50:17.884449 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 107/207] 10.222.0.104 () {60 vars in 1293 bytes} [Thu Oct 28 09:50:17 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:50:18.377306 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-0e28d3cd-5bc9-49bc-8b64-80321baec938 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:18.378001 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-0e28d3cd-5bc9-49bc-8b64-80321baec938 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:18.388427 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0e28d3cd-5bc9-49bc-8b64-80321baec938 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:18.389289 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0e28d3cd-5bc9-49bc-8b64-80321baec938 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:18.390115 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0e28d3cd-5bc9-49bc-8b64-80321baec938 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:18.390560 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0e28d3cd-5bc9-49bc-8b64-80321baec938 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:18.621165 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-0e28d3cd-5bc9-49bc-8b64-80321baec938 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:18.636075 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-0e28d3cd-5bc9-49bc-8b64-80321baec938 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1526 microversion: 2.1 time: 0.262290 Oct 28 09:50:18.637652 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 101/208] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:18 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1526 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:19.655722 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-7eaf3892-82f3-402b-82c7-91458afe9688 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:19.657083 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-7eaf3892-82f3-402b-82c7-91458afe9688 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:19.665888 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7eaf3892-82f3-402b-82c7-91458afe9688 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:19.666558 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7eaf3892-82f3-402b-82c7-91458afe9688 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:19.667981 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7eaf3892-82f3-402b-82c7-91458afe9688 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:19.668905 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7eaf3892-82f3-402b-82c7-91458afe9688 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:19.895598 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-7eaf3892-82f3-402b-82c7-91458afe9688 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:19.897063 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-7eaf3892-82f3-402b-82c7-91458afe9688 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1526 microversion: 2.1 time: 0.245372 Oct 28 09:50:19.898695 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 108/209] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:19 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1526 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:20.914928 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-748554e0-4250-4bdd-866f-44d9ea57838b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:20.915525 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-748554e0-4250-4bdd-866f-44d9ea57838b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:20.921966 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-748554e0-4250-4bdd-866f-44d9ea57838b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:20.922406 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-748554e0-4250-4bdd-866f-44d9ea57838b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:20.923169 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-748554e0-4250-4bdd-866f-44d9ea57838b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:20.923592 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-748554e0-4250-4bdd-866f-44d9ea57838b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:21.196070 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-748554e0-4250-4bdd-866f-44d9ea57838b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:21.204967 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-748554e0-4250-4bdd-866f-44d9ea57838b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1526 microversion: 2.1 time: 0.293561 Oct 28 09:50:21.205542 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 102/210] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:20 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1526 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:21.589244 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-a891960d-37b7-46a0-93dc-7f57ebc41d87 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:21.590841 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-a891960d-37b7-46a0-93dc-7f57ebc41d87 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:21.597819 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a891960d-37b7-46a0-93dc-7f57ebc41d87 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:21.598258 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a891960d-37b7-46a0-93dc-7f57ebc41d87 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:21.602610 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a891960d-37b7-46a0-93dc-7f57ebc41d87 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:21.603137 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a891960d-37b7-46a0-93dc-7f57ebc41d87 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:21.650788 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.objects.instance [None req-a891960d-37b7-46a0-93dc-7f57ebc41d87 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lazy-loading 'flavor' on Instance uuid b49b31e1-36d8-4096-a5fc-b2d46ef922eb {{(pid=123068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 09:50:21.814566 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-027447a3-43ff-408e-9e5c-f3e34c8faaa2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:21.828846 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-027447a3-43ff-408e-9e5c-f3e34c8faaa2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:21.829920 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-027447a3-43ff-408e-9e5c-f3e34c8faaa2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:21.979651 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-027447a3-43ff-408e-9e5c-f3e34c8faaa2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Going to try to stop instance {{(pid=123069) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Oct 28 09:50:22.277950 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-027447a3-43ff-408e-9e5c-f3e34c8faaa2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 202 len: 0 microversion: 2.1 time: 0.469427 Oct 28 09:50:22.278872 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 103/211] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:50:21 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:50:22.296092 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-1d235bbe-7318-4dbf-bcff-60183f3855a6 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:22.302974 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-1d235bbe-7318-4dbf-bcff-60183f3855a6 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:22.320021 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1d235bbe-7318-4dbf-bcff-60183f3855a6 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:22.320802 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1d235bbe-7318-4dbf-bcff-60183f3855a6 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:22.321848 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1d235bbe-7318-4dbf-bcff-60183f3855a6 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:22.322499 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1d235bbe-7318-4dbf-bcff-60183f3855a6 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:22.555215 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-1d235bbe-7318-4dbf-bcff-60183f3855a6 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:22.565504 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-1d235bbe-7318-4dbf-bcff-60183f3855a6 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1526 microversion: 2.1 time: 0.285159 Oct 28 09:50:22.577194 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 104/212] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:22 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1526 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:22.584747 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-6dc29fcc-b9a5-46a8-bc28-b39668bf216a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:22.587655 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-6dc29fcc-b9a5-46a8-bc28-b39668bf216a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:22.612567 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6dc29fcc-b9a5-46a8-bc28-b39668bf216a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:22.613248 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6dc29fcc-b9a5-46a8-bc28-b39668bf216a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:22.614130 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6dc29fcc-b9a5-46a8-bc28-b39668bf216a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:22.618867 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6dc29fcc-b9a5-46a8-bc28-b39668bf216a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:22.921497 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-6dc29fcc-b9a5-46a8-bc28-b39668bf216a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:22.937529 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-6dc29fcc-b9a5-46a8-bc28-b39668bf216a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1727 microversion: 2.1 time: 0.369990 Oct 28 09:50:22.950910 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 105/213] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:22 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1727 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:23.585071 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-85851492-b1fc-4cf7-b144-6078cbeca745 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:23.586471 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-85851492-b1fc-4cf7-b144-6078cbeca745 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:23.595489 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-85851492-b1fc-4cf7-b144-6078cbeca745 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:23.596195 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-85851492-b1fc-4cf7-b144-6078cbeca745 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:23.597342 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-85851492-b1fc-4cf7-b144-6078cbeca745 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:23.598392 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-85851492-b1fc-4cf7-b144-6078cbeca745 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:23.756844 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-85851492-b1fc-4cf7-b144-6078cbeca745 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:23.765304 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-85851492-b1fc-4cf7-b144-6078cbeca745 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1526 microversion: 2.1 time: 0.185777 Oct 28 09:50:23.766198 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 106/214] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:23 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1526 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:23.957938 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-076ced3d-aed7-4e98-80f1-b2e35deffb3f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:23.958686 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-076ced3d-aed7-4e98-80f1-b2e35deffb3f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:23.966410 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-076ced3d-aed7-4e98-80f1-b2e35deffb3f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:23.966857 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-076ced3d-aed7-4e98-80f1-b2e35deffb3f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:23.984038 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-076ced3d-aed7-4e98-80f1-b2e35deffb3f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:23.985312 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-076ced3d-aed7-4e98-80f1-b2e35deffb3f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:24.216016 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-076ced3d-aed7-4e98-80f1-b2e35deffb3f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:24.224816 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-076ced3d-aed7-4e98-80f1-b2e35deffb3f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1727 microversion: 2.1 time: 0.270527 Oct 28 09:50:24.225525 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 107/215] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:23 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1727 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:24.783947 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-b83efe63-d199-46da-ad23-3206e18f04b7 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:24.784861 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-b83efe63-d199-46da-ad23-3206e18f04b7 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:24.798716 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b83efe63-d199-46da-ad23-3206e18f04b7 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:24.799155 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b83efe63-d199-46da-ad23-3206e18f04b7 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:24.802699 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b83efe63-d199-46da-ad23-3206e18f04b7 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:24.802699 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b83efe63-d199-46da-ad23-3206e18f04b7 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:25.002791 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-b83efe63-d199-46da-ad23-3206e18f04b7 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:25.012411 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-b83efe63-d199-46da-ad23-3206e18f04b7 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1526 microversion: 2.1 time: 0.232349 Oct 28 09:50:25.022857 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 108/216] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:24 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1526 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:50:25.115569 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-a891960d-37b7-46a0-93dc-7f57ebc41d87 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 202 len: 0 microversion: 2.20 time: 3.532406 Oct 28 09:50:25.119135 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 109/217] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:50:21 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 0 bytes in 3539 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:50:25.134437 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-ff3c7a90-882c-4d8a-b864-7b177c2e1be3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:25.138565 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-ff3c7a90-882c-4d8a-b864-7b177c2e1be3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:25.152638 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ff3c7a90-882c-4d8a-b864-7b177c2e1be3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:25.153206 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ff3c7a90-882c-4d8a-b864-7b177c2e1be3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:25.154164 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ff3c7a90-882c-4d8a-b864-7b177c2e1be3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:25.155500 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ff3c7a90-882c-4d8a-b864-7b177c2e1be3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:25.243729 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-dbddef52-3582-4c8e-aa09-4fd5119614de tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:25.246093 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-dbddef52-3582-4c8e-aa09-4fd5119614de tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:25.270372 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-dbddef52-3582-4c8e-aa09-4fd5119614de tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:25.272307 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-dbddef52-3582-4c8e-aa09-4fd5119614de tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:25.273444 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-dbddef52-3582-4c8e-aa09-4fd5119614de tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:25.278114 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-dbddef52-3582-4c8e-aa09-4fd5119614de tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:25.498629 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-ff3c7a90-882c-4d8a-b864-7b177c2e1be3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:25.507945 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-ff3c7a90-882c-4d8a-b864-7b177c2e1be3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:25.519368 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-ff3c7a90-882c-4d8a-b864-7b177c2e1be3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:25.521342 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-ff3c7a90-882c-4d8a-b864-7b177c2e1be3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1727 microversion: 2.20 time: 0.396410 Oct 28 09:50:25.536328 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 109/218] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:50:25 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1727 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:50:25.752171 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-dbddef52-3582-4c8e-aa09-4fd5119614de tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:25.764108 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-dbddef52-3582-4c8e-aa09-4fd5119614de tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1727 microversion: 2.1 time: 0.524351 Oct 28 09:50:25.765396 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 110/219] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:25 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1727 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:50:25.924296 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-a261a690-3eea-434c-a0fc-680b51791c9d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Action: 'create', calling method: .version_select at 0x7fe121717a60>, body: {"keypair": {"name": "tempest-TestShelveInstance-359364649"}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:25.953453 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.quota [None req-a261a690-3eea-434c-a0fc-680b51791c9d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Getting quotas for project 8171734427fe4b4bb14d52d4d336a76b. Resources: {'key_pairs'} {{(pid=123069) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 09:50:25.953453 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.quota [None req-a261a690-3eea-434c-a0fc-680b51791c9d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Getting quotas for user 9859c6302ddc418da07047bf02603788 and project 8171734427fe4b4bb14d52d4d336a76b. Resources: {'key_pairs'} {{(pid=123069) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 09:50:26.029749 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-99251ba3-3e58-4d10-b223-6bc768fc5edb tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:26.030592 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-99251ba3-3e58-4d10-b223-6bc768fc5edb tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:26.037277 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-99251ba3-3e58-4d10-b223-6bc768fc5edb tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:26.037952 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-99251ba3-3e58-4d10-b223-6bc768fc5edb tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:26.038737 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-99251ba3-3e58-4d10-b223-6bc768fc5edb tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:26.039162 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-99251ba3-3e58-4d10-b223-6bc768fc5edb tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:26.320279 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.quota [None req-a261a690-3eea-434c-a0fc-680b51791c9d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Getting quotas for project 8171734427fe4b4bb14d52d4d336a76b. Resources: {'key_pairs'} {{(pid=123069) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 09:50:26.326505 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.quota [None req-a261a690-3eea-434c-a0fc-680b51791c9d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Getting quotas for user 9859c6302ddc418da07047bf02603788 and project 8171734427fe4b4bb14d52d4d336a76b. Resources: {'key_pairs'} {{(pid=123069) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 09:50:26.341253 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-a261a690-3eea-434c-a0fc-680b51791c9d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.694193 Oct 28 09:50:26.341942 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 110/220] 10.222.0.104 () {60 vars in 1162 bytes} [Thu Oct 28 09:50:25 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:26.414931 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-99251ba3-3e58-4d10-b223-6bc768fc5edb tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:26.446910 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-99251ba3-3e58-4d10-b223-6bc768fc5edb tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1526 microversion: 2.1 time: 0.416234 Oct 28 09:50:26.446910 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 111/221] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:26 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1526 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:50:26.549628 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-9bd58683-9023-425f-a645-8256fe32ec20 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:26.552757 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-9bd58683-9023-425f-a645-8256fe32ec20 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:26.564184 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9bd58683-9023-425f-a645-8256fe32ec20 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:26.564974 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9bd58683-9023-425f-a645-8256fe32ec20 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:26.567578 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9bd58683-9023-425f-a645-8256fe32ec20 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:26.568187 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9bd58683-9023-425f-a645-8256fe32ec20 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:26.780998 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-9bd58683-9023-425f-a645-8256fe32ec20 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:26.781922 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-ddd1d08e-2ee3-4cf6-aeaa-546931ff7f1b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:26.782741 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-ddd1d08e-2ee3-4cf6-aeaa-546931ff7f1b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:26.791886 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ddd1d08e-2ee3-4cf6-aeaa-546931ff7f1b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:26.792748 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ddd1d08e-2ee3-4cf6-aeaa-546931ff7f1b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:26.794289 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ddd1d08e-2ee3-4cf6-aeaa-546931ff7f1b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:26.797867 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ddd1d08e-2ee3-4cf6-aeaa-546931ff7f1b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:26.801234 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-9bd58683-9023-425f-a645-8256fe32ec20 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:26.803852 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-9bd58683-9023-425f-a645-8256fe32ec20 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:26.805161 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-9bd58683-9023-425f-a645-8256fe32ec20 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1727 microversion: 2.20 time: 0.266319 Oct 28 09:50:26.806967 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 111/222] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:50:26 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1727 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:50:26.961866 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-ddd1d08e-2ee3-4cf6-aeaa-546931ff7f1b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:26.971715 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-ddd1d08e-2ee3-4cf6-aeaa-546931ff7f1b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1727 microversion: 2.1 time: 0.193451 Oct 28 09:50:26.972581 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 112/223] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:26 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1727 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:50:27.468341 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-14339a8c-e66e-43ec-8e61-802cff4c74cc tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:27.472189 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-14339a8c-e66e-43ec-8e61-802cff4c74cc tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:27.484633 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-14339a8c-e66e-43ec-8e61-802cff4c74cc tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:27.485813 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-14339a8c-e66e-43ec-8e61-802cff4c74cc tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:27.491791 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-14339a8c-e66e-43ec-8e61-802cff4c74cc tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:27.500644 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-14339a8c-e66e-43ec-8e61-802cff4c74cc tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:27.710109 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-14339a8c-e66e-43ec-8e61-802cff4c74cc tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:27.729991 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-14339a8c-e66e-43ec-8e61-802cff4c74cc tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1526 microversion: 2.1 time: 0.261334 Oct 28 09:50:27.736957 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 112/224] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:27 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1526 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:27.825276 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-2bdef382-2986-4d76-9748-cd78a563c144 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:27.826267 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-2bdef382-2986-4d76-9748-cd78a563c144 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:27.832648 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2bdef382-2986-4d76-9748-cd78a563c144 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:27.833204 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2bdef382-2986-4d76-9748-cd78a563c144 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:27.834019 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2bdef382-2986-4d76-9748-cd78a563c144 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:27.834693 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2bdef382-2986-4d76-9748-cd78a563c144 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:27.992623 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-2bdef382-2986-4d76-9748-cd78a563c144 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:27.999817 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-d675585d-cd94-4318-acb5-1f6bc0a7bd99 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:28.000444 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-d675585d-cd94-4318-acb5-1f6bc0a7bd99 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:28.011012 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-2bdef382-2986-4d76-9748-cd78a563c144 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:28.013181 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-2bdef382-2986-4d76-9748-cd78a563c144 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:28.014879 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-2bdef382-2986-4d76-9748-cd78a563c144 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1727 microversion: 2.20 time: 0.193940 Oct 28 09:50:28.016168 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 113/225] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:50:27 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1727 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:50:28.016931 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d675585d-cd94-4318-acb5-1f6bc0a7bd99 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:28.017612 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d675585d-cd94-4318-acb5-1f6bc0a7bd99 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:28.022211 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d675585d-cd94-4318-acb5-1f6bc0a7bd99 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:28.022211 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d675585d-cd94-4318-acb5-1f6bc0a7bd99 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:28.199000 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-d675585d-cd94-4318-acb5-1f6bc0a7bd99 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:28.207251 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-d675585d-cd94-4318-acb5-1f6bc0a7bd99 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1727 microversion: 2.1 time: 0.221459 Oct 28 09:50:28.207842 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 113/226] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:27 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1727 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:28.741673 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-1c161db8-1f5d-4120-b94d-55f0e5516eb8 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:28.745384 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-1c161db8-1f5d-4120-b94d-55f0e5516eb8 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:28.752773 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1c161db8-1f5d-4120-b94d-55f0e5516eb8 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:28.754068 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1c161db8-1f5d-4120-b94d-55f0e5516eb8 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:28.755201 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1c161db8-1f5d-4120-b94d-55f0e5516eb8 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:28.755986 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1c161db8-1f5d-4120-b94d-55f0e5516eb8 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:29.035092 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-fa4da010-0116-4c80-95fd-3749cac53852 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:29.036454 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-fa4da010-0116-4c80-95fd-3749cac53852 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:29.044966 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fa4da010-0116-4c80-95fd-3749cac53852 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:29.048611 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fa4da010-0116-4c80-95fd-3749cac53852 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:29.048611 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fa4da010-0116-4c80-95fd-3749cac53852 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:29.048611 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fa4da010-0116-4c80-95fd-3749cac53852 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:29.268200 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-1c161db8-1f5d-4120-b94d-55f0e5516eb8 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:29.287026 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-1c161db8-1f5d-4120-b94d-55f0e5516eb8 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1526 microversion: 2.1 time: 0.552872 Oct 28 09:50:29.287881 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 114/227] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:28 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1526 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:29.296317 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-a3cd61c4-bfca-4d7e-9eed-99900e5b0728 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:29.297179 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-a3cd61c4-bfca-4d7e-9eed-99900e5b0728 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:29.304728 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a3cd61c4-bfca-4d7e-9eed-99900e5b0728 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:29.305433 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a3cd61c4-bfca-4d7e-9eed-99900e5b0728 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:29.306766 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a3cd61c4-bfca-4d7e-9eed-99900e5b0728 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:29.308044 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a3cd61c4-bfca-4d7e-9eed-99900e5b0728 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:29.319771 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-fa4da010-0116-4c80-95fd-3749cac53852 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:29.338138 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-fa4da010-0116-4c80-95fd-3749cac53852 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:29.341138 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-fa4da010-0116-4c80-95fd-3749cac53852 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:29.342504 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-fa4da010-0116-4c80-95fd-3749cac53852 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1727 microversion: 2.20 time: 0.311543 Oct 28 09:50:29.356441 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 114/228] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:50:29 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1727 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:50:29.490654 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-a3cd61c4-bfca-4d7e-9eed-99900e5b0728 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:29.499108 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-a3cd61c4-bfca-4d7e-9eed-99900e5b0728 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1727 microversion: 2.1 time: 0.208790 Oct 28 09:50:29.499681 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 115/229] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:29 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1727 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:30.305206 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-4a0ec3f6-6558-468d-8235-8401ecf3f7bb tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:30.305807 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-4a0ec3f6-6558-468d-8235-8401ecf3f7bb tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:30.313216 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4a0ec3f6-6558-468d-8235-8401ecf3f7bb tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:30.313658 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4a0ec3f6-6558-468d-8235-8401ecf3f7bb tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:30.314436 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4a0ec3f6-6558-468d-8235-8401ecf3f7bb tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:30.314867 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4a0ec3f6-6558-468d-8235-8401ecf3f7bb tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:30.361009 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-2f94b40d-2103-48ba-911d-b1742fb27039 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:30.361617 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-2f94b40d-2103-48ba-911d-b1742fb27039 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:30.368321 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2f94b40d-2103-48ba-911d-b1742fb27039 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:30.368799 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2f94b40d-2103-48ba-911d-b1742fb27039 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:30.370286 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2f94b40d-2103-48ba-911d-b1742fb27039 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:30.370789 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2f94b40d-2103-48ba-911d-b1742fb27039 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:30.488640 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-4a0ec3f6-6558-468d-8235-8401ecf3f7bb tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:30.500118 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-4a0ec3f6-6558-468d-8235-8401ecf3f7bb tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1526 microversion: 2.1 time: 0.198444 Oct 28 09:50:30.512764 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 115/230] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:30 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1526 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:30.531846 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-e349d464-20f0-4415-9275-3a2996fb457a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:30.532594 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-e349d464-20f0-4415-9275-3a2996fb457a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:30.554555 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e349d464-20f0-4415-9275-3a2996fb457a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:30.554555 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e349d464-20f0-4415-9275-3a2996fb457a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:30.557798 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e349d464-20f0-4415-9275-3a2996fb457a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:30.558319 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e349d464-20f0-4415-9275-3a2996fb457a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:30.603225 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-2f94b40d-2103-48ba-911d-b1742fb27039 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:30.623855 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-2f94b40d-2103-48ba-911d-b1742fb27039 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:30.626546 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-2f94b40d-2103-48ba-911d-b1742fb27039 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:30.628938 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-2f94b40d-2103-48ba-911d-b1742fb27039 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1727 microversion: 2.20 time: 0.271737 Oct 28 09:50:30.656900 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 116/231] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:50:30 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1727 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:50:30.773620 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-e349d464-20f0-4415-9275-3a2996fb457a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:30.793053 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-e349d464-20f0-4415-9275-3a2996fb457a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1727 microversion: 2.1 time: 0.274415 Oct 28 09:50:30.794074 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 116/232] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:30 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1727 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:31.519350 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-1f34dcf5-899d-4261-8827-ce71259cc4e8 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:31.520928 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-1f34dcf5-899d-4261-8827-ce71259cc4e8 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:31.528282 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1f34dcf5-899d-4261-8827-ce71259cc4e8 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:31.528845 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1f34dcf5-899d-4261-8827-ce71259cc4e8 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:31.529782 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1f34dcf5-899d-4261-8827-ce71259cc4e8 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:31.530284 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1f34dcf5-899d-4261-8827-ce71259cc4e8 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:31.655034 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-1c49cda4-792c-44de-8261-39cd68311d30 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:31.655807 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-1c49cda4-792c-44de-8261-39cd68311d30 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:31.663400 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1c49cda4-792c-44de-8261-39cd68311d30 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:31.668728 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1c49cda4-792c-44de-8261-39cd68311d30 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:31.668728 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1c49cda4-792c-44de-8261-39cd68311d30 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:31.668728 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1c49cda4-792c-44de-8261-39cd68311d30 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:31.682588 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-1f34dcf5-899d-4261-8827-ce71259cc4e8 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:31.692267 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-1f34dcf5-899d-4261-8827-ce71259cc4e8 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1526 microversion: 2.1 time: 0.176543 Oct 28 09:50:31.702791 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 117/233] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:31 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1526 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:31.812561 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-581e8aea-ade2-4e20-a2f3-865aa11dce39 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:31.813758 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-581e8aea-ade2-4e20-a2f3-865aa11dce39 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:31.823641 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-581e8aea-ade2-4e20-a2f3-865aa11dce39 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:31.824174 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-581e8aea-ade2-4e20-a2f3-865aa11dce39 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:31.826120 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-581e8aea-ade2-4e20-a2f3-865aa11dce39 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:31.826632 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-581e8aea-ade2-4e20-a2f3-865aa11dce39 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:31.863864 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-1c49cda4-792c-44de-8261-39cd68311d30 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:31.873491 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-1c49cda4-792c-44de-8261-39cd68311d30 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:31.875012 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-1c49cda4-792c-44de-8261-39cd68311d30 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:31.877242 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-1c49cda4-792c-44de-8261-39cd68311d30 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1727 microversion: 2.20 time: 0.226970 Oct 28 09:50:31.889246 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 117/234] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:50:31 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1727 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:50:32.004071 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-581e8aea-ade2-4e20-a2f3-865aa11dce39 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:32.013531 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-581e8aea-ade2-4e20-a2f3-865aa11dce39 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1727 microversion: 2.1 time: 0.206497 Oct 28 09:50:32.014151 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 118/235] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:31 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1727 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:50:32.709091 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-9bac32a5-ae21-4add-b21b-eae66168e1c9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:32.731494 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-9bac32a5-ae21-4add-b21b-eae66168e1c9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:32.731494 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9bac32a5-ae21-4add-b21b-eae66168e1c9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:32.731494 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9bac32a5-ae21-4add-b21b-eae66168e1c9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:32.731494 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9bac32a5-ae21-4add-b21b-eae66168e1c9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:32.731879 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9bac32a5-ae21-4add-b21b-eae66168e1c9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:32.856222 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-9bac32a5-ae21-4add-b21b-eae66168e1c9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:32.863884 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-9bac32a5-ae21-4add-b21b-eae66168e1c9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1526 microversion: 2.1 time: 0.158494 Oct 28 09:50:32.864466 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 118/236] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:32 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1526 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:32.895959 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-2a0e6485-34a1-4157-9d01-7f2eed3361a8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:32.896637 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-2a0e6485-34a1-4157-9d01-7f2eed3361a8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:32.904292 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2a0e6485-34a1-4157-9d01-7f2eed3361a8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:32.989033 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2a0e6485-34a1-4157-9d01-7f2eed3361a8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:32.989033 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2a0e6485-34a1-4157-9d01-7f2eed3361a8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:32.989033 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2a0e6485-34a1-4157-9d01-7f2eed3361a8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:33.031398 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-49c3765e-c628-4df3-8201-d257998f5eb9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:33.032024 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-49c3765e-c628-4df3-8201-d257998f5eb9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:33.039254 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-49c3765e-c628-4df3-8201-d257998f5eb9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:33.039695 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-49c3765e-c628-4df3-8201-d257998f5eb9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:33.040507 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-49c3765e-c628-4df3-8201-d257998f5eb9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:33.041416 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-49c3765e-c628-4df3-8201-d257998f5eb9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:33.065547 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-2a0e6485-34a1-4157-9d01-7f2eed3361a8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:33.069224 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-2a0e6485-34a1-4157-9d01-7f2eed3361a8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:33.069224 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-2a0e6485-34a1-4157-9d01-7f2eed3361a8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:33.070111 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-2a0e6485-34a1-4157-9d01-7f2eed3361a8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1727 microversion: 2.20 time: 0.177716 Oct 28 09:50:33.073170 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 119/237] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:50:32 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:50:33.175001 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-49c3765e-c628-4df3-8201-d257998f5eb9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:33.184235 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-49c3765e-c628-4df3-8201-d257998f5eb9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1727 microversion: 2.1 time: 0.156654 Oct 28 09:50:33.185007 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 119/238] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:33 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:50:33.881605 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-281d4914-da01-4058-8c56-c28f0e31593a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:33.882222 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-281d4914-da01-4058-8c56-c28f0e31593a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:33.888259 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-281d4914-da01-4058-8c56-c28f0e31593a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:33.888747 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-281d4914-da01-4058-8c56-c28f0e31593a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:33.889726 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-281d4914-da01-4058-8c56-c28f0e31593a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:33.890161 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-281d4914-da01-4058-8c56-c28f0e31593a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:34.019116 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-281d4914-da01-4058-8c56-c28f0e31593a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:34.028144 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-281d4914-da01-4058-8c56-c28f0e31593a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1526 microversion: 2.1 time: 0.150076 Oct 28 09:50:34.028746 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 120/239] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:33 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1526 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:50:34.090000 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-d9ef377c-8927-4410-b51d-43c352e73f1c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:34.090697 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-d9ef377c-8927-4410-b51d-43c352e73f1c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:34.098938 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d9ef377c-8927-4410-b51d-43c352e73f1c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:34.099381 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d9ef377c-8927-4410-b51d-43c352e73f1c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:34.100387 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d9ef377c-8927-4410-b51d-43c352e73f1c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:34.101026 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d9ef377c-8927-4410-b51d-43c352e73f1c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:34.201344 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-a5e636e2-7390-4670-813e-76ce0d9a8d52 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:34.202173 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-a5e636e2-7390-4670-813e-76ce0d9a8d52 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:34.208667 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a5e636e2-7390-4670-813e-76ce0d9a8d52 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:34.209395 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a5e636e2-7390-4670-813e-76ce0d9a8d52 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:34.210410 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a5e636e2-7390-4670-813e-76ce0d9a8d52 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:34.211138 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a5e636e2-7390-4670-813e-76ce0d9a8d52 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:34.241592 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-d9ef377c-8927-4410-b51d-43c352e73f1c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:34.256326 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-d9ef377c-8927-4410-b51d-43c352e73f1c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:34.258379 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-d9ef377c-8927-4410-b51d-43c352e73f1c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:34.260615 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-d9ef377c-8927-4410-b51d-43c352e73f1c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1727 microversion: 2.20 time: 0.174404 Oct 28 09:50:34.264045 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 120/240] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:50:34 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:50:34.357907 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-a5e636e2-7390-4670-813e-76ce0d9a8d52 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:34.366337 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-a5e636e2-7390-4670-813e-76ce0d9a8d52 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1727 microversion: 2.1 time: 0.168532 Oct 28 09:50:34.366812 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 121/241] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:34 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:35.046566 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-88b40b51-9469-41a1-8dce-60601f438432 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:35.047365 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-88b40b51-9469-41a1-8dce-60601f438432 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:35.055434 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-88b40b51-9469-41a1-8dce-60601f438432 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:35.056244 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-88b40b51-9469-41a1-8dce-60601f438432 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:35.057823 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-88b40b51-9469-41a1-8dce-60601f438432 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:35.058356 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-88b40b51-9469-41a1-8dce-60601f438432 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:35.198358 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-88b40b51-9469-41a1-8dce-60601f438432 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:35.206127 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-88b40b51-9469-41a1-8dce-60601f438432 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1526 microversion: 2.1 time: 0.163532 Oct 28 09:50:35.206695 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 121/242] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:35 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1526 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:35.282207 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-82a8d6fe-5d98-4ee3-8bc0-5e43a989c174 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:35.283390 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-82a8d6fe-5d98-4ee3-8bc0-5e43a989c174 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:35.294185 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-82a8d6fe-5d98-4ee3-8bc0-5e43a989c174 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:35.294635 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-82a8d6fe-5d98-4ee3-8bc0-5e43a989c174 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:35.295424 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-82a8d6fe-5d98-4ee3-8bc0-5e43a989c174 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:35.295884 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-82a8d6fe-5d98-4ee3-8bc0-5e43a989c174 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:35.387601 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-8d76400c-f752-407c-8481-dbe543cd99e2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:35.388058 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-8d76400c-f752-407c-8481-dbe543cd99e2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:35.393950 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8d76400c-f752-407c-8481-dbe543cd99e2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:35.394402 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8d76400c-f752-407c-8481-dbe543cd99e2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:35.395176 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8d76400c-f752-407c-8481-dbe543cd99e2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:35.395606 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8d76400c-f752-407c-8481-dbe543cd99e2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:35.441666 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-82a8d6fe-5d98-4ee3-8bc0-5e43a989c174 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:35.452955 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-82a8d6fe-5d98-4ee3-8bc0-5e43a989c174 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:35.454522 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-82a8d6fe-5d98-4ee3-8bc0-5e43a989c174 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:35.456097 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-82a8d6fe-5d98-4ee3-8bc0-5e43a989c174 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1727 microversion: 2.20 time: 0.178039 Oct 28 09:50:35.456940 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 122/243] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:50:35 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:50:35.539428 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-8d76400c-f752-407c-8481-dbe543cd99e2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:35.557786 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-8d76400c-f752-407c-8481-dbe543cd99e2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1727 microversion: 2.1 time: 0.174835 Oct 28 09:50:35.575302 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 122/244] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:35 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1727 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:36.224097 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-bc98b566-32a2-4633-9b6e-9a0cd0fd4d3c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:36.224771 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-bc98b566-32a2-4633-9b6e-9a0cd0fd4d3c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:36.230700 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bc98b566-32a2-4633-9b6e-9a0cd0fd4d3c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:36.231142 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bc98b566-32a2-4633-9b6e-9a0cd0fd4d3c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:36.231897 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bc98b566-32a2-4633-9b6e-9a0cd0fd4d3c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:36.232319 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bc98b566-32a2-4633-9b6e-9a0cd0fd4d3c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:36.361048 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-bc98b566-32a2-4633-9b6e-9a0cd0fd4d3c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:36.369156 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-bc98b566-32a2-4633-9b6e-9a0cd0fd4d3c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1526 microversion: 2.1 time: 0.148438 Oct 28 09:50:36.369907 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 123/245] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:36 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1526 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:50:36.475226 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-3b0037ef-1f7a-42b2-aacd-32a0c1507a9b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:36.475879 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-3b0037ef-1f7a-42b2-aacd-32a0c1507a9b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:36.483333 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3b0037ef-1f7a-42b2-aacd-32a0c1507a9b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:36.483777 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3b0037ef-1f7a-42b2-aacd-32a0c1507a9b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:36.484614 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3b0037ef-1f7a-42b2-aacd-32a0c1507a9b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:36.485075 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3b0037ef-1f7a-42b2-aacd-32a0c1507a9b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:36.581027 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-1f76bcb9-c724-4d2b-848a-6c9f8de992a9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:36.581656 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-1f76bcb9-c724-4d2b-848a-6c9f8de992a9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:36.607128 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1f76bcb9-c724-4d2b-848a-6c9f8de992a9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:36.608005 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1f76bcb9-c724-4d2b-848a-6c9f8de992a9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:36.608816 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1f76bcb9-c724-4d2b-848a-6c9f8de992a9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:36.609453 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1f76bcb9-c724-4d2b-848a-6c9f8de992a9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:36.647538 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-3b0037ef-1f7a-42b2-aacd-32a0c1507a9b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:36.658191 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-3b0037ef-1f7a-42b2-aacd-32a0c1507a9b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:36.661511 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-3b0037ef-1f7a-42b2-aacd-32a0c1507a9b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:36.663238 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-3b0037ef-1f7a-42b2-aacd-32a0c1507a9b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1727 microversion: 2.20 time: 0.191773 Oct 28 09:50:36.676844 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 123/246] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:50:36 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1727 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:50:36.806385 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-1f76bcb9-c724-4d2b-848a-6c9f8de992a9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:36.815877 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-1f76bcb9-c724-4d2b-848a-6c9f8de992a9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1727 microversion: 2.1 time: 0.239674 Oct 28 09:50:36.820874 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 124/247] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:36 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1727 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:50:37.397916 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-204a5e2e-4056-436e-b0e7-67344b31fad4 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:37.400369 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-204a5e2e-4056-436e-b0e7-67344b31fad4 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:37.408187 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-204a5e2e-4056-436e-b0e7-67344b31fad4 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:37.408926 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-204a5e2e-4056-436e-b0e7-67344b31fad4 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:37.410754 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-204a5e2e-4056-436e-b0e7-67344b31fad4 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:37.411897 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-204a5e2e-4056-436e-b0e7-67344b31fad4 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:37.656563 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-204a5e2e-4056-436e-b0e7-67344b31fad4 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:37.665453 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-204a5e2e-4056-436e-b0e7-67344b31fad4 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1526 microversion: 2.1 time: 0.282037 Oct 28 09:50:37.666443 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 124/248] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:37 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1526 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:37.682463 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-e7f7a18a-41ba-4bf4-b21a-55f6f2aa382d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:37.682463 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-e7f7a18a-41ba-4bf4-b21a-55f6f2aa382d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:37.691482 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e7f7a18a-41ba-4bf4-b21a-55f6f2aa382d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:37.692138 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e7f7a18a-41ba-4bf4-b21a-55f6f2aa382d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:37.693199 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e7f7a18a-41ba-4bf4-b21a-55f6f2aa382d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:37.693828 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e7f7a18a-41ba-4bf4-b21a-55f6f2aa382d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:37.835745 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-dcd9d754-94a2-4df9-961d-d27ec0a1458d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:37.836319 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-dcd9d754-94a2-4df9-961d-d27ec0a1458d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:37.844462 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-dcd9d754-94a2-4df9-961d-d27ec0a1458d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:37.844949 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-dcd9d754-94a2-4df9-961d-d27ec0a1458d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:37.845772 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-dcd9d754-94a2-4df9-961d-d27ec0a1458d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:37.846128 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-dcd9d754-94a2-4df9-961d-d27ec0a1458d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:37.950863 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-e7f7a18a-41ba-4bf4-b21a-55f6f2aa382d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:37.958646 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-e7f7a18a-41ba-4bf4-b21a-55f6f2aa382d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:37.960227 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-e7f7a18a-41ba-4bf4-b21a-55f6f2aa382d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:37.961518 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-e7f7a18a-41ba-4bf4-b21a-55f6f2aa382d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1727 microversion: 2.20 time: 0.284081 Oct 28 09:50:37.962169 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 125/249] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:50:37 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1727 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:50:38.104936 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-dcd9d754-94a2-4df9-961d-d27ec0a1458d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:38.118537 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-dcd9d754-94a2-4df9-961d-d27ec0a1458d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1727 microversion: 2.1 time: 0.283473 Oct 28 09:50:38.118537 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 125/250] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:37 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1727 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:38.684679 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-5accc0bd-62b6-4687-90ab-2b0d2d0ecf6f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:38.686051 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-5accc0bd-62b6-4687-90ab-2b0d2d0ecf6f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:38.693336 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5accc0bd-62b6-4687-90ab-2b0d2d0ecf6f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:38.693794 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5accc0bd-62b6-4687-90ab-2b0d2d0ecf6f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:38.694894 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5accc0bd-62b6-4687-90ab-2b0d2d0ecf6f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:38.695011 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5accc0bd-62b6-4687-90ab-2b0d2d0ecf6f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:38.866467 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-5accc0bd-62b6-4687-90ab-2b0d2d0ecf6f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:38.871087 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-5accc0bd-62b6-4687-90ab-2b0d2d0ecf6f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1526 microversion: 2.1 time: 0.190151 Oct 28 09:50:38.871670 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 126/251] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:38 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1526 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:38.981932 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-73fac99b-9ba3-4244-8346-7c692694edf2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:38.982513 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-73fac99b-9ba3-4244-8346-7c692694edf2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:38.996283 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-73fac99b-9ba3-4244-8346-7c692694edf2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:38.998927 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-73fac99b-9ba3-4244-8346-7c692694edf2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:38.998927 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-73fac99b-9ba3-4244-8346-7c692694edf2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:38.999227 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-73fac99b-9ba3-4244-8346-7c692694edf2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:39.135727 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-33911914-361b-431e-a5e7-5ed381e3abab tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:39.137778 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-33911914-361b-431e-a5e7-5ed381e3abab tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:39.144289 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-33911914-361b-431e-a5e7-5ed381e3abab tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:39.145052 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-33911914-361b-431e-a5e7-5ed381e3abab tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:39.146023 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-33911914-361b-431e-a5e7-5ed381e3abab tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:39.146911 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-33911914-361b-431e-a5e7-5ed381e3abab tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:39.175048 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-73fac99b-9ba3-4244-8346-7c692694edf2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:39.185608 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-73fac99b-9ba3-4244-8346-7c692694edf2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:39.190322 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-73fac99b-9ba3-4244-8346-7c692694edf2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:39.195203 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-73fac99b-9ba3-4244-8346-7c692694edf2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1727 microversion: 2.20 time: 0.217810 Oct 28 09:50:39.196573 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 126/252] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:50:38 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1727 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:50:39.310788 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-33911914-361b-431e-a5e7-5ed381e3abab tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:39.319118 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-33911914-361b-431e-a5e7-5ed381e3abab tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1727 microversion: 2.1 time: 0.187587 Oct 28 09:50:39.319894 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 127/253] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:39 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1727 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:39.888403 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-4178adcd-56a8-4fec-b873-7c5ffcd1ae64 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:39.889140 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-4178adcd-56a8-4fec-b873-7c5ffcd1ae64 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:39.900009 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4178adcd-56a8-4fec-b873-7c5ffcd1ae64 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:39.901502 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4178adcd-56a8-4fec-b873-7c5ffcd1ae64 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:39.904595 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4178adcd-56a8-4fec-b873-7c5ffcd1ae64 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:39.905157 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4178adcd-56a8-4fec-b873-7c5ffcd1ae64 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:40.088370 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-4178adcd-56a8-4fec-b873-7c5ffcd1ae64 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:40.097364 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-4178adcd-56a8-4fec-b873-7c5ffcd1ae64 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1526 microversion: 2.1 time: 0.213501 Oct 28 09:50:40.097943 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 127/254] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:39 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1526 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:40.215088 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-c79e0bc5-96b7-4f08-a20c-cdcc1d976916 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:40.216376 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-c79e0bc5-96b7-4f08-a20c-cdcc1d976916 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:40.223777 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c79e0bc5-96b7-4f08-a20c-cdcc1d976916 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:40.224774 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c79e0bc5-96b7-4f08-a20c-cdcc1d976916 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:40.225735 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c79e0bc5-96b7-4f08-a20c-cdcc1d976916 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:40.226164 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c79e0bc5-96b7-4f08-a20c-cdcc1d976916 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:40.340988 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-405c49b0-c08d-4d5f-b18e-73f2b4804bdf tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:40.340988 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-405c49b0-c08d-4d5f-b18e-73f2b4804bdf tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:40.354535 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-405c49b0-c08d-4d5f-b18e-73f2b4804bdf tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:40.355248 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-405c49b0-c08d-4d5f-b18e-73f2b4804bdf tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:40.356129 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-405c49b0-c08d-4d5f-b18e-73f2b4804bdf tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:40.356776 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-405c49b0-c08d-4d5f-b18e-73f2b4804bdf tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:40.441939 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-c79e0bc5-96b7-4f08-a20c-cdcc1d976916 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:40.454911 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-c79e0bc5-96b7-4f08-a20c-cdcc1d976916 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:40.462232 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-c79e0bc5-96b7-4f08-a20c-cdcc1d976916 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:40.468541 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-c79e0bc5-96b7-4f08-a20c-cdcc1d976916 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1727 microversion: 2.20 time: 0.258248 Oct 28 09:50:40.473215 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 128/255] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:50:40 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1727 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:50:40.604244 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-405c49b0-c08d-4d5f-b18e-73f2b4804bdf tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:40.618614 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-405c49b0-c08d-4d5f-b18e-73f2b4804bdf tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1704 microversion: 2.1 time: 0.284271 Oct 28 09:50:40.624712 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 128/256] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:40 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1704 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:40.641060 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-28b4e194-eba8-4fa9-9fea-0a1db36ebefa tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:40.648072 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-28b4e194-eba8-4fa9-9fea-0a1db36ebefa tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:40.648526 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-28b4e194-eba8-4fa9-9fea-0a1db36ebefa tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:40.752895 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-28b4e194-eba8-4fa9-9fea-0a1db36ebefa tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Going to try to start instance {{(pid=123068) start /opt/stack/nova/nova/compute/api.py:2675}} Oct 28 09:50:41.044587 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-28b4e194-eba8-4fa9-9fea-0a1db36ebefa tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 202 len: 0 microversion: 2.1 time: 0.410754 Oct 28 09:50:41.045359 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 129/257] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:50:40 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:50:41.053315 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-c4119497-4414-4dcf-8117-2fdf8ddfade2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:41.053916 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-c4119497-4414-4dcf-8117-2fdf8ddfade2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:41.061113 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c4119497-4414-4dcf-8117-2fdf8ddfade2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:41.061552 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c4119497-4414-4dcf-8117-2fdf8ddfade2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:41.062380 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c4119497-4414-4dcf-8117-2fdf8ddfade2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:41.062854 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c4119497-4414-4dcf-8117-2fdf8ddfade2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:41.117269 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-0e6d7aa2-a132-430f-9eee-aa6b95ee2d9e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:41.117701 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-0e6d7aa2-a132-430f-9eee-aa6b95ee2d9e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:41.125678 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0e6d7aa2-a132-430f-9eee-aa6b95ee2d9e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:41.126550 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0e6d7aa2-a132-430f-9eee-aa6b95ee2d9e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:41.127590 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0e6d7aa2-a132-430f-9eee-aa6b95ee2d9e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:41.128996 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0e6d7aa2-a132-430f-9eee-aa6b95ee2d9e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:41.377884 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-c4119497-4414-4dcf-8117-2fdf8ddfade2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:41.389387 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-c4119497-4414-4dcf-8117-2fdf8ddfade2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1713 microversion: 2.1 time: 0.339499 Oct 28 09:50:41.390400 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 129/258] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:41 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1713 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:50:41.489153 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-9cb13a4e-36c7-49aa-ab01-91675671ee16 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:41.492567 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-9cb13a4e-36c7-49aa-ab01-91675671ee16 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:41.496159 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9cb13a4e-36c7-49aa-ab01-91675671ee16 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:41.496605 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9cb13a4e-36c7-49aa-ab01-91675671ee16 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:41.497455 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9cb13a4e-36c7-49aa-ab01-91675671ee16 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:41.497890 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9cb13a4e-36c7-49aa-ab01-91675671ee16 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:41.786440 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-0e6d7aa2-a132-430f-9eee-aa6b95ee2d9e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:41.805215 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-0e6d7aa2-a132-430f-9eee-aa6b95ee2d9e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1526 microversion: 2.1 time: 0.694226 Oct 28 09:50:41.806038 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 130/259] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:41 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1526 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:50:41.937473 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-9cb13a4e-36c7-49aa-ab01-91675671ee16 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:41.954483 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-9cb13a4e-36c7-49aa-ab01-91675671ee16 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:41.956173 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-9cb13a4e-36c7-49aa-ab01-91675671ee16 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:41.957408 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-9cb13a4e-36c7-49aa-ab01-91675671ee16 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1748 microversion: 2.20 time: 0.471984 Oct 28 09:50:41.958185 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 130/260] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:50:41 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1748 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:50:42.411656 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-b6f7deff-d3b1-4651-ad9f-83c9007f16ac tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:42.413205 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-b6f7deff-d3b1-4651-ad9f-83c9007f16ac tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:42.426002 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b6f7deff-d3b1-4651-ad9f-83c9007f16ac tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:42.426752 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b6f7deff-d3b1-4651-ad9f-83c9007f16ac tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:42.428134 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b6f7deff-d3b1-4651-ad9f-83c9007f16ac tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:42.429056 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b6f7deff-d3b1-4651-ad9f-83c9007f16ac tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:42.618207 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-b6f7deff-d3b1-4651-ad9f-83c9007f16ac tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:42.628249 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-b6f7deff-d3b1-4651-ad9f-83c9007f16ac tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1713 microversion: 2.1 time: 0.223847 Oct 28 09:50:42.629058 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 131/261] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:42 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1713 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:42.823790 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-23456cfe-2246-4b95-858f-1295c14f0542 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:42.824373 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-23456cfe-2246-4b95-858f-1295c14f0542 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:42.830774 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-23456cfe-2246-4b95-858f-1295c14f0542 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:42.831193 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-23456cfe-2246-4b95-858f-1295c14f0542 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:42.831958 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-23456cfe-2246-4b95-858f-1295c14f0542 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:42.832382 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-23456cfe-2246-4b95-858f-1295c14f0542 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:42.982712 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-23456cfe-2246-4b95-858f-1295c14f0542 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:42.991409 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-dc654fc5-697f-4f09-8827-8bfb603daed1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:42.995555 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-dc654fc5-697f-4f09-8827-8bfb603daed1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:43.021773 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-23456cfe-2246-4b95-858f-1295c14f0542 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1526 microversion: 2.1 time: 0.202205 Oct 28 09:50:43.022924 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-dc654fc5-697f-4f09-8827-8bfb603daed1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:43.026388 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-dc654fc5-697f-4f09-8827-8bfb603daed1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:43.027221 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 131/262] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:42 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1526 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:43.029568 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-dc654fc5-697f-4f09-8827-8bfb603daed1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:43.030297 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-dc654fc5-697f-4f09-8827-8bfb603daed1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:43.212613 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-dc654fc5-697f-4f09-8827-8bfb603daed1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:43.224759 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-dc654fc5-697f-4f09-8827-8bfb603daed1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:43.227467 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-dc654fc5-697f-4f09-8827-8bfb603daed1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:43.237654 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-dc654fc5-697f-4f09-8827-8bfb603daed1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1748 microversion: 2.20 time: 0.243704 Oct 28 09:50:43.237654 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 132/263] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:50:42 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1748 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:50:43.647519 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-b77c8c04-3c20-451b-a44b-45ea6ac3c1e6 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:43.648118 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-b77c8c04-3c20-451b-a44b-45ea6ac3c1e6 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:43.655432 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b77c8c04-3c20-451b-a44b-45ea6ac3c1e6 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:43.656055 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b77c8c04-3c20-451b-a44b-45ea6ac3c1e6 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:43.657221 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b77c8c04-3c20-451b-a44b-45ea6ac3c1e6 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:43.657797 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b77c8c04-3c20-451b-a44b-45ea6ac3c1e6 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:43.808871 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-b77c8c04-3c20-451b-a44b-45ea6ac3c1e6 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:43.819171 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-b77c8c04-3c20-451b-a44b-45ea6ac3c1e6 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1717 microversion: 2.1 time: 0.175516 Oct 28 09:50:43.819993 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 132/264] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:43 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1717 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:44.046410 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-d9c42e54-cc83-42c7-ab59-9be92000425e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:44.047314 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-d9c42e54-cc83-42c7-ab59-9be92000425e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:44.065046 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d9c42e54-cc83-42c7-ab59-9be92000425e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:44.065805 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d9c42e54-cc83-42c7-ab59-9be92000425e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:44.066835 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d9c42e54-cc83-42c7-ab59-9be92000425e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:44.067435 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d9c42e54-cc83-42c7-ab59-9be92000425e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:44.250864 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-101449f9-d7fa-4f58-83fa-01baf032cf03 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:44.251391 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-101449f9-d7fa-4f58-83fa-01baf032cf03 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:44.268241 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-101449f9-d7fa-4f58-83fa-01baf032cf03 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:44.268750 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-101449f9-d7fa-4f58-83fa-01baf032cf03 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:44.269583 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-101449f9-d7fa-4f58-83fa-01baf032cf03 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:44.270040 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-101449f9-d7fa-4f58-83fa-01baf032cf03 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:44.315579 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-d9c42e54-cc83-42c7-ab59-9be92000425e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:44.331824 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-d9c42e54-cc83-42c7-ab59-9be92000425e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1526 microversion: 2.1 time: 0.290522 Oct 28 09:50:44.332599 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 133/265] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:44 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1526 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:44.463601 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-101449f9-d7fa-4f58-83fa-01baf032cf03 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:44.472805 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-101449f9-d7fa-4f58-83fa-01baf032cf03 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:44.474625 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-101449f9-d7fa-4f58-83fa-01baf032cf03 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:44.483787 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-101449f9-d7fa-4f58-83fa-01baf032cf03 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1748 microversion: 2.20 time: 0.234636 Oct 28 09:50:44.486070 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 133/266] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:50:44 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1748 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:50:44.908469 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-e6f3d949-0ea7-4640-a2c5-1d0a1052a5a2 req-d95442e6-8684-49a1-a291-29547924b1e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b49b31e1-36d8-4096-a5fc-b2d46ef922eb", "name": "network-vif-plugged", "status": "completed", "tag": "b51e7b00-09ad-41ca-b851-00805473b75a"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:44.910113 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:50:44.910113 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:50:44.917645 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-e6f3d949-0ea7-4640-a2c5-1d0a1052a5a2 req-d95442e6-8684-49a1-a291-29547924b1e6 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:44.918073 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-e6f3d949-0ea7-4640-a2c5-1d0a1052a5a2 req-d95442e6-8684-49a1-a291-29547924b1e6 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:44.931123 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-e6f3d949-0ea7-4640-a2c5-1d0a1052a5a2 req-d95442e6-8684-49a1-a291-29547924b1e6 service nova] Creating event network-vif-plugged:b51e7b00-09ad-41ca-b851-00805473b75a for instance b49b31e1-36d8-4096-a5fc-b2d46ef922eb on hv-cinder-81571 Oct 28 09:50:44.939440 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-e6f3d949-0ea7-4640-a2c5-1d0a1052a5a2 req-d95442e6-8684-49a1-a291-29547924b1e6 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034022 Oct 28 09:50:44.940501 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 134/267] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:50:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:45.352871 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-2133d56d-5518-418d-83ba-9f15281f182c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:45.352871 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-2133d56d-5518-418d-83ba-9f15281f182c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:45.363263 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2133d56d-5518-418d-83ba-9f15281f182c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:45.377149 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2133d56d-5518-418d-83ba-9f15281f182c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:45.378256 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2133d56d-5518-418d-83ba-9f15281f182c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:45.378673 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2133d56d-5518-418d-83ba-9f15281f182c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:45.507060 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-9091f0c6-6c76-4789-abbe-96cf74288204 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:45.509202 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-9091f0c6-6c76-4789-abbe-96cf74288204 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:45.523813 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9091f0c6-6c76-4789-abbe-96cf74288204 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:45.524358 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9091f0c6-6c76-4789-abbe-96cf74288204 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:45.525809 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9091f0c6-6c76-4789-abbe-96cf74288204 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:45.527686 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9091f0c6-6c76-4789-abbe-96cf74288204 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:45.754328 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-2133d56d-5518-418d-83ba-9f15281f182c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:45.764371 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-2133d56d-5518-418d-83ba-9f15281f182c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1526 microversion: 2.1 time: 0.417445 Oct 28 09:50:45.765039 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 134/268] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:45 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1526 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:45.824578 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-9091f0c6-6c76-4789-abbe-96cf74288204 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:45.840157 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-9091f0c6-6c76-4789-abbe-96cf74288204 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:45.842621 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-9091f0c6-6c76-4789-abbe-96cf74288204 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:45.851540 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-9091f0c6-6c76-4789-abbe-96cf74288204 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1743 microversion: 2.20 time: 0.350692 Oct 28 09:50:45.857034 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 135/269] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:50:45 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1743 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:50:46.787536 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-6b7ba30b-658e-4508-a3e6-6a33ededa901 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:46.788468 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-6b7ba30b-658e-4508-a3e6-6a33ededa901 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:46.799571 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6b7ba30b-658e-4508-a3e6-6a33ededa901 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:46.804029 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6b7ba30b-658e-4508-a3e6-6a33ededa901 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:46.804029 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6b7ba30b-658e-4508-a3e6-6a33ededa901 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:46.804029 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6b7ba30b-658e-4508-a3e6-6a33ededa901 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:46.903758 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-8f8dab80-63c5-4b56-a43f-a741b3d278d8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:46.904491 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-8f8dab80-63c5-4b56-a43f-a741b3d278d8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:46.930533 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8f8dab80-63c5-4b56-a43f-a741b3d278d8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:46.931263 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8f8dab80-63c5-4b56-a43f-a741b3d278d8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:46.937418 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8f8dab80-63c5-4b56-a43f-a741b3d278d8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:46.938692 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8f8dab80-63c5-4b56-a43f-a741b3d278d8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:47.218697 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-6b7ba30b-658e-4508-a3e6-6a33ededa901 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:47.237165 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-6b7ba30b-658e-4508-a3e6-6a33ededa901 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1526 microversion: 2.1 time: 0.449392 Oct 28 09:50:47.237165 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 135/270] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:46 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1526 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:47.360451 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-8f8dab80-63c5-4b56-a43f-a741b3d278d8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:47.370389 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-8f8dab80-63c5-4b56-a43f-a741b3d278d8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:47.372681 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-8f8dab80-63c5-4b56-a43f-a741b3d278d8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:47.377973 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-8f8dab80-63c5-4b56-a43f-a741b3d278d8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1743 microversion: 2.20 time: 0.476238 Oct 28 09:50:47.377973 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 136/271] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:50:46 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1743 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:50:48.260646 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-982c333a-8acb-4290-a041-cdc6cb511680 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:48.261880 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-982c333a-8acb-4290-a041-cdc6cb511680 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:48.274908 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-982c333a-8acb-4290-a041-cdc6cb511680 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:48.277075 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-982c333a-8acb-4290-a041-cdc6cb511680 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:48.278322 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-982c333a-8acb-4290-a041-cdc6cb511680 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:48.281118 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-982c333a-8acb-4290-a041-cdc6cb511680 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:48.394019 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-3b831138-413d-4bc0-a576-cc7b056b3301 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:48.395268 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-3b831138-413d-4bc0-a576-cc7b056b3301 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:48.406101 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3b831138-413d-4bc0-a576-cc7b056b3301 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:48.409873 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3b831138-413d-4bc0-a576-cc7b056b3301 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:48.423321 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3b831138-413d-4bc0-a576-cc7b056b3301 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:48.427655 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3b831138-413d-4bc0-a576-cc7b056b3301 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:48.950304 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-3b831138-413d-4bc0-a576-cc7b056b3301 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:48.959209 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-3b831138-413d-4bc0-a576-cc7b056b3301 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:48.959480 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-982c333a-8acb-4290-a041-cdc6cb511680 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:48.961385 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-3b831138-413d-4bc0-a576-cc7b056b3301 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:48.963281 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-3b831138-413d-4bc0-a576-cc7b056b3301 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1743 microversion: 2.20 time: 0.572547 Oct 28 09:50:48.971042 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-982c333a-8acb-4290-a041-cdc6cb511680 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1526 microversion: 2.1 time: 0.714624 Oct 28 09:50:48.972122 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 136/272] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:48 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1526 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:48.976770 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 137/273] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:50:48 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1743 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:50:49.985944 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-0b787041-8852-41e0-be30-39e7914fc2ce tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:49.986539 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-0b787041-8852-41e0-be30-39e7914fc2ce tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:49.995618 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-c31f7a83-d0ca-4dab-94c3-df501430ad1f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:49.996381 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-c31f7a83-d0ca-4dab-94c3-df501430ad1f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:49.996892 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0b787041-8852-41e0-be30-39e7914fc2ce tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:50.001223 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0b787041-8852-41e0-be30-39e7914fc2ce tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:50.002554 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0b787041-8852-41e0-be30-39e7914fc2ce tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:50.003885 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0b787041-8852-41e0-be30-39e7914fc2ce tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:50.019648 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c31f7a83-d0ca-4dab-94c3-df501430ad1f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:50.026059 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c31f7a83-d0ca-4dab-94c3-df501430ad1f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:50.027484 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c31f7a83-d0ca-4dab-94c3-df501430ad1f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:50.036848 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c31f7a83-d0ca-4dab-94c3-df501430ad1f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:50.317852 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-c31f7a83-d0ca-4dab-94c3-df501430ad1f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:50.322395 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-0b787041-8852-41e0-be30-39e7914fc2ce tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:50.327784 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-c31f7a83-d0ca-4dab-94c3-df501430ad1f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1526 microversion: 2.1 time: 0.336765 Oct 28 09:50:50.328534 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 138/274] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:49 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1526 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:50.331697 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-0b787041-8852-41e0-be30-39e7914fc2ce tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:50.333769 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-0b787041-8852-41e0-be30-39e7914fc2ce tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:50.335100 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-0b787041-8852-41e0-be30-39e7914fc2ce tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1743 microversion: 2.20 time: 0.352866 Oct 28 09:50:50.335557 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 137/275] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:50:49 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1743 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:50:51.345659 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-ae4cc065-03a3-4d85-a854-9ffd10fa61a9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:51.346483 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-ae4cc065-03a3-4d85-a854-9ffd10fa61a9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:51.354466 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ae4cc065-03a3-4d85-a854-9ffd10fa61a9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:51.354918 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ae4cc065-03a3-4d85-a854-9ffd10fa61a9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:51.355742 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ae4cc065-03a3-4d85-a854-9ffd10fa61a9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:51.356015 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-0930f22f-5cad-4fab-8e85-96463e992364 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:51.356480 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ae4cc065-03a3-4d85-a854-9ffd10fa61a9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:51.357358 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-0930f22f-5cad-4fab-8e85-96463e992364 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:51.363946 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0930f22f-5cad-4fab-8e85-96463e992364 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:51.364392 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0930f22f-5cad-4fab-8e85-96463e992364 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:51.365307 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0930f22f-5cad-4fab-8e85-96463e992364 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:51.365997 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0930f22f-5cad-4fab-8e85-96463e992364 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:51.561054 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-ae4cc065-03a3-4d85-a854-9ffd10fa61a9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:51.568870 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-ae4cc065-03a3-4d85-a854-9ffd10fa61a9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1526 microversion: 2.1 time: 0.227284 Oct 28 09:50:51.569663 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 139/276] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:51 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1526 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:51.580829 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-0930f22f-5cad-4fab-8e85-96463e992364 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:51.590613 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-0930f22f-5cad-4fab-8e85-96463e992364 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:51.592127 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-0930f22f-5cad-4fab-8e85-96463e992364 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:51.593477 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-0930f22f-5cad-4fab-8e85-96463e992364 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1743 microversion: 2.20 time: 0.242577 Oct 28 09:50:51.594053 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 138/277] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:50:51 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1743 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:50:52.586871 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-f40e53d8-fa94-4348-bde9-441999d8505f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:52.588085 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-f40e53d8-fa94-4348-bde9-441999d8505f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:52.606850 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f40e53d8-fa94-4348-bde9-441999d8505f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:52.607712 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f40e53d8-fa94-4348-bde9-441999d8505f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:52.608968 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f40e53d8-fa94-4348-bde9-441999d8505f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:52.609705 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f40e53d8-fa94-4348-bde9-441999d8505f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:52.615739 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-378e8126-4792-4386-b49c-c04f6a25b10f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:52.615739 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-378e8126-4792-4386-b49c-c04f6a25b10f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:52.622370 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-378e8126-4792-4386-b49c-c04f6a25b10f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:52.625736 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-378e8126-4792-4386-b49c-c04f6a25b10f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:52.626573 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-378e8126-4792-4386-b49c-c04f6a25b10f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:52.627199 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-378e8126-4792-4386-b49c-c04f6a25b10f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:52.922434 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-f40e53d8-fa94-4348-bde9-441999d8505f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:52.928771 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-378e8126-4792-4386-b49c-c04f6a25b10f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:52.944198 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-378e8126-4792-4386-b49c-c04f6a25b10f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:52.944968 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-f40e53d8-fa94-4348-bde9-441999d8505f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1526 microversion: 2.1 time: 0.361217 Oct 28 09:50:52.945751 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-378e8126-4792-4386-b49c-c04f6a25b10f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:52.947982 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-378e8126-4792-4386-b49c-c04f6a25b10f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1743 microversion: 2.20 time: 0.340196 Oct 28 09:50:52.949113 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 140/278] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:52 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1526 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:52.960045 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 139/279] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:50:52 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1743 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:50:53.967015 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-cb58b0fa-2a7c-471f-afc6-a6d88c9e1ee0 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:53.967888 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-cb58b0fa-2a7c-471f-afc6-a6d88c9e1ee0 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:53.969594 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-4ee97ff9-70cc-42c4-b9b1-57f8602e864f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:53.974550 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-4ee97ff9-70cc-42c4-b9b1-57f8602e864f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:53.975669 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cb58b0fa-2a7c-471f-afc6-a6d88c9e1ee0 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:53.976246 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cb58b0fa-2a7c-471f-afc6-a6d88c9e1ee0 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:53.977183 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cb58b0fa-2a7c-471f-afc6-a6d88c9e1ee0 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:53.977739 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cb58b0fa-2a7c-471f-afc6-a6d88c9e1ee0 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:53.990354 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4ee97ff9-70cc-42c4-b9b1-57f8602e864f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:53.991295 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4ee97ff9-70cc-42c4-b9b1-57f8602e864f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:53.992323 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4ee97ff9-70cc-42c4-b9b1-57f8602e864f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:53.992897 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4ee97ff9-70cc-42c4-b9b1-57f8602e864f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:54.206957 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-cb58b0fa-2a7c-471f-afc6-a6d88c9e1ee0 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:54.213162 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-4ee97ff9-70cc-42c4-b9b1-57f8602e864f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:54.218987 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-cb58b0fa-2a7c-471f-afc6-a6d88c9e1ee0 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1526 microversion: 2.1 time: 0.257242 Oct 28 09:50:54.220207 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 141/280] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:53 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1526 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:54.222237 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-4ee97ff9-70cc-42c4-b9b1-57f8602e864f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:54.224046 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-4ee97ff9-70cc-42c4-b9b1-57f8602e864f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:54.225401 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-4ee97ff9-70cc-42c4-b9b1-57f8602e864f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1743 microversion: 2.20 time: 0.261041 Oct 28 09:50:54.225987 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 140/281] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:50:53 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1743 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:50:55.244764 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-fdd76d73-5735-47e8-a358-b18ed19b0769 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:55.245464 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-fdd76d73-5735-47e8-a358-b18ed19b0769 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:55.246039 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-cb1081e5-b57d-4fba-90bb-7d1c7f38c15b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:55.246835 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-cb1081e5-b57d-4fba-90bb-7d1c7f38c15b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:55.251641 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fdd76d73-5735-47e8-a358-b18ed19b0769 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:55.252077 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fdd76d73-5735-47e8-a358-b18ed19b0769 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:55.252884 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fdd76d73-5735-47e8-a358-b18ed19b0769 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:55.253314 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fdd76d73-5735-47e8-a358-b18ed19b0769 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:55.253465 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-cb1081e5-b57d-4fba-90bb-7d1c7f38c15b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:55.253902 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-cb1081e5-b57d-4fba-90bb-7d1c7f38c15b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:55.254679 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-cb1081e5-b57d-4fba-90bb-7d1c7f38c15b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:55.255099 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-cb1081e5-b57d-4fba-90bb-7d1c7f38c15b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:55.456352 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-fdd76d73-5735-47e8-a358-b18ed19b0769 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:55.466374 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-cb1081e5-b57d-4fba-90bb-7d1c7f38c15b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:55.466665 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-fdd76d73-5735-47e8-a358-b18ed19b0769 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:55.468362 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-fdd76d73-5735-47e8-a358-b18ed19b0769 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:55.470158 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-fdd76d73-5735-47e8-a358-b18ed19b0769 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1743 microversion: 2.20 time: 0.229462 Oct 28 09:50:55.471010 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 142/282] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:50:55 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1743 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:50:55.474555 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-cb1081e5-b57d-4fba-90bb-7d1c7f38c15b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1526 microversion: 2.1 time: 0.232219 Oct 28 09:50:55.475684 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 141/283] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:55 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1526 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:50:56.493025 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-b6da2eea-f4cd-47fd-bbc7-ae96609b8e4d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:56.494220 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-b6da2eea-f4cd-47fd-bbc7-ae96609b8e4d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:56.494767 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-b7daa5f3-14e1-4bad-9002-665fca6cb958 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:56.495617 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-b7daa5f3-14e1-4bad-9002-665fca6cb958 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:56.500722 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b6da2eea-f4cd-47fd-bbc7-ae96609b8e4d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:56.501303 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b6da2eea-f4cd-47fd-bbc7-ae96609b8e4d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:56.502096 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b6da2eea-f4cd-47fd-bbc7-ae96609b8e4d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:56.502542 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b6da2eea-f4cd-47fd-bbc7-ae96609b8e4d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:56.503345 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b7daa5f3-14e1-4bad-9002-665fca6cb958 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:56.504196 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b7daa5f3-14e1-4bad-9002-665fca6cb958 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:56.505181 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b7daa5f3-14e1-4bad-9002-665fca6cb958 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:56.505809 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b7daa5f3-14e1-4bad-9002-665fca6cb958 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:56.699412 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-b7daa5f3-14e1-4bad-9002-665fca6cb958 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:56.709629 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-b7daa5f3-14e1-4bad-9002-665fca6cb958 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1526 microversion: 2.1 time: 0.220012 Oct 28 09:50:56.714502 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-b6da2eea-f4cd-47fd-bbc7-ae96609b8e4d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:56.714764 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 142/284] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:56 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1526 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:56.726772 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-b6da2eea-f4cd-47fd-bbc7-ae96609b8e4d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:56.728320 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-b6da2eea-f4cd-47fd-bbc7-ae96609b8e4d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:56.729610 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-b6da2eea-f4cd-47fd-bbc7-ae96609b8e4d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1743 microversion: 2.20 time: 0.240507 Oct 28 09:50:56.731276 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 143/285] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:50:56 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1743 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:50:57.732390 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-c38282e3-bc04-4eeb-a8f7-ebf2c14add28 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:57.733853 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-c38282e3-bc04-4eeb-a8f7-ebf2c14add28 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:57.740814 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c38282e3-bc04-4eeb-a8f7-ebf2c14add28 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:57.741701 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c38282e3-bc04-4eeb-a8f7-ebf2c14add28 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:57.744596 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c38282e3-bc04-4eeb-a8f7-ebf2c14add28 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:57.745167 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c38282e3-bc04-4eeb-a8f7-ebf2c14add28 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:57.752614 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-c85067bd-afc3-4d1b-bf95-a5562cb7769d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:57.754702 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-c85067bd-afc3-4d1b-bf95-a5562cb7769d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:57.768051 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c85067bd-afc3-4d1b-bf95-a5562cb7769d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:57.782568 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c85067bd-afc3-4d1b-bf95-a5562cb7769d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:57.782568 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c85067bd-afc3-4d1b-bf95-a5562cb7769d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:57.782568 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c85067bd-afc3-4d1b-bf95-a5562cb7769d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:58.024440 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-c38282e3-bc04-4eeb-a8f7-ebf2c14add28 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:58.041997 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-c38282e3-bc04-4eeb-a8f7-ebf2c14add28 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1526 microversion: 2.1 time: 0.313766 Oct 28 09:50:58.043054 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 143/286] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:57 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1526 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:50:58.122299 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-c85067bd-afc3-4d1b-bf95-a5562cb7769d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:58.138748 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-c85067bd-afc3-4d1b-bf95-a5562cb7769d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:58.141734 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-c85067bd-afc3-4d1b-bf95-a5562cb7769d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:58.143912 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-c85067bd-afc3-4d1b-bf95-a5562cb7769d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1743 microversion: 2.20 time: 0.397718 Oct 28 09:50:58.145609 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 144/287] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:50:57 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1743 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:50:59.070057 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-a0eb1700-513d-4305-8bf9-d7bf339374b0 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:59.074685 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-a0eb1700-513d-4305-8bf9-d7bf339374b0 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:59.092995 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a0eb1700-513d-4305-8bf9-d7bf339374b0 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:59.094332 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a0eb1700-513d-4305-8bf9-d7bf339374b0 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:59.095774 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a0eb1700-513d-4305-8bf9-d7bf339374b0 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:59.096497 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a0eb1700-513d-4305-8bf9-d7bf339374b0 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:59.164045 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-f9154bde-f057-4fbd-9735-b4fc864e1bdc tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:59.166963 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-f9154bde-f057-4fbd-9735-b4fc864e1bdc tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:50:59.182457 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f9154bde-f057-4fbd-9735-b4fc864e1bdc tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:59.183365 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f9154bde-f057-4fbd-9735-b4fc864e1bdc tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:59.185640 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f9154bde-f057-4fbd-9735-b4fc864e1bdc tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:50:59.186533 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f9154bde-f057-4fbd-9735-b4fc864e1bdc tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:50:59.419145 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-a0eb1700-513d-4305-8bf9-d7bf339374b0 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:59.428142 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-a0eb1700-513d-4305-8bf9-d7bf339374b0 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1526 microversion: 2.1 time: 0.367007 Oct 28 09:50:59.445324 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 144/288] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:50:59 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1526 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:59.500813 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-f9154bde-f057-4fbd-9735-b4fc864e1bdc tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:59.516205 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-f9154bde-f057-4fbd-9735-b4fc864e1bdc tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:59.519133 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-f9154bde-f057-4fbd-9735-b4fc864e1bdc tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:59.520626 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-f9154bde-f057-4fbd-9735-b4fc864e1bdc tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1743 microversion: 2.20 time: 0.361457 Oct 28 09:50:59.521985 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 145/289] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:50:59 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1743 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:51:00.454014 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-a5fb8256-e3ab-4cbe-a9a4-77959d7dfe20 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:00.454731 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-a5fb8256-e3ab-4cbe-a9a4-77959d7dfe20 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:00.462089 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a5fb8256-e3ab-4cbe-a9a4-77959d7dfe20 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:00.462546 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a5fb8256-e3ab-4cbe-a9a4-77959d7dfe20 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:00.463929 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a5fb8256-e3ab-4cbe-a9a4-77959d7dfe20 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:00.464683 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a5fb8256-e3ab-4cbe-a9a4-77959d7dfe20 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:00.551780 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-619a2210-91dd-4cf0-936e-4a946965212a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:00.553016 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-619a2210-91dd-4cf0-936e-4a946965212a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:00.562101 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-619a2210-91dd-4cf0-936e-4a946965212a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:00.563469 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-619a2210-91dd-4cf0-936e-4a946965212a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:00.564669 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-619a2210-91dd-4cf0-936e-4a946965212a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:00.565930 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-619a2210-91dd-4cf0-936e-4a946965212a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:00.700062 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-a5fb8256-e3ab-4cbe-a9a4-77959d7dfe20 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:00.716872 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-a5fb8256-e3ab-4cbe-a9a4-77959d7dfe20 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1526 microversion: 2.1 time: 0.268151 Oct 28 09:51:00.717465 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 145/290] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:00 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1526 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:00.785126 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-619a2210-91dd-4cf0-936e-4a946965212a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:00.801345 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-619a2210-91dd-4cf0-936e-4a946965212a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:00.804523 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-619a2210-91dd-4cf0-936e-4a946965212a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:00.807819 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-619a2210-91dd-4cf0-936e-4a946965212a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1743 microversion: 2.20 time: 0.264661 Oct 28 09:51:00.809408 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 146/291] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:51:00 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1743 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:01.740446 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-e5195086-ef2b-42c9-a461-1bb19ba095e1 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:01.746203 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-e5195086-ef2b-42c9-a461-1bb19ba095e1 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:01.761903 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e5195086-ef2b-42c9-a461-1bb19ba095e1 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:01.761903 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e5195086-ef2b-42c9-a461-1bb19ba095e1 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:01.761903 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e5195086-ef2b-42c9-a461-1bb19ba095e1 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:01.761903 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e5195086-ef2b-42c9-a461-1bb19ba095e1 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:01.834240 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-2a930830-945b-4915-8d92-4e373f534752 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:01.838213 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-2a930830-945b-4915-8d92-4e373f534752 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:01.853895 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2a930830-945b-4915-8d92-4e373f534752 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:01.854347 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2a930830-945b-4915-8d92-4e373f534752 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:01.855158 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2a930830-945b-4915-8d92-4e373f534752 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:01.855590 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2a930830-945b-4915-8d92-4e373f534752 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:02.036033 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-e5195086-ef2b-42c9-a461-1bb19ba095e1 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:02.044162 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-e5195086-ef2b-42c9-a461-1bb19ba095e1 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1526 microversion: 2.1 time: 0.312125 Oct 28 09:51:02.057344 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 146/292] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:01 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1526 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:02.129867 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-2a930830-945b-4915-8d92-4e373f534752 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:02.150440 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-2a930830-945b-4915-8d92-4e373f534752 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:02.152011 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-2a930830-945b-4915-8d92-4e373f534752 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:02.153257 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-2a930830-945b-4915-8d92-4e373f534752 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1743 microversion: 2.20 time: 0.329530 Oct 28 09:51:02.153829 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 147/293] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:51:01 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1743 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:03.064683 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-781549a6-85b2-4622-a436-2931c808690a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:03.066036 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-781549a6-85b2-4622-a436-2931c808690a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:03.086903 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-781549a6-85b2-4622-a436-2931c808690a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:03.087910 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-781549a6-85b2-4622-a436-2931c808690a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:03.088742 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-781549a6-85b2-4622-a436-2931c808690a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:03.089171 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-781549a6-85b2-4622-a436-2931c808690a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:03.176302 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-5fa19a3e-9839-40d9-bef7-2bc5d87cd449 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:03.177314 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-5fa19a3e-9839-40d9-bef7-2bc5d87cd449 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:03.188560 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5fa19a3e-9839-40d9-bef7-2bc5d87cd449 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:03.189038 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5fa19a3e-9839-40d9-bef7-2bc5d87cd449 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:03.189838 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5fa19a3e-9839-40d9-bef7-2bc5d87cd449 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:03.190275 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5fa19a3e-9839-40d9-bef7-2bc5d87cd449 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:03.316283 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-781549a6-85b2-4622-a436-2931c808690a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:03.374189 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-781549a6-85b2-4622-a436-2931c808690a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1506 microversion: 2.1 time: 0.311621 Oct 28 09:51:03.375947 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 147/294] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:03 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1506 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:03.409964 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-483786ee-c56c-4e97-9a74-08409f46993d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:03.409964 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-483786ee-c56c-4e97-9a74-08409f46993d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:03.412147 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-5fa19a3e-9839-40d9-bef7-2bc5d87cd449 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:03.420265 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-483786ee-c56c-4e97-9a74-08409f46993d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:03.420578 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-483786ee-c56c-4e97-9a74-08409f46993d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:03.421590 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-483786ee-c56c-4e97-9a74-08409f46993d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:03.422181 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-483786ee-c56c-4e97-9a74-08409f46993d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:03.422298 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-5fa19a3e-9839-40d9-bef7-2bc5d87cd449 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:03.424555 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-5fa19a3e-9839-40d9-bef7-2bc5d87cd449 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:03.425888 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-5fa19a3e-9839-40d9-bef7-2bc5d87cd449 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1743 microversion: 2.20 time: 0.256302 Oct 28 09:51:03.438428 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 148/295] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:51:03 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1743 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:51:03.595219 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-483786ee-c56c-4e97-9a74-08409f46993d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:03.603858 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-483786ee-c56c-4e97-9a74-08409f46993d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1521 microversion: 2.1 time: 0.198534 Oct 28 09:51:03.605158 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 148/296] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:03 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:04.446109 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-8c180f8a-7e73-4fb1-b0c1-2442bc449ed4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:04.447786 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-8c180f8a-7e73-4fb1-b0c1-2442bc449ed4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:04.454566 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8c180f8a-7e73-4fb1-b0c1-2442bc449ed4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:04.455009 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8c180f8a-7e73-4fb1-b0c1-2442bc449ed4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:04.455784 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8c180f8a-7e73-4fb1-b0c1-2442bc449ed4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:04.456207 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8c180f8a-7e73-4fb1-b0c1-2442bc449ed4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:04.596923 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-8c180f8a-7e73-4fb1-b0c1-2442bc449ed4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:04.606240 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-8c180f8a-7e73-4fb1-b0c1-2442bc449ed4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:04.608329 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-8c180f8a-7e73-4fb1-b0c1-2442bc449ed4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:04.609425 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-8c180f8a-7e73-4fb1-b0c1-2442bc449ed4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1743 microversion: 2.20 time: 0.167030 Oct 28 09:51:04.609804 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 149/297] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:51:04 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1743 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:05.630601 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-c96dca5d-180f-4c14-891f-f5f803754a9b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:05.632561 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-c96dca5d-180f-4c14-891f-f5f803754a9b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:05.658162 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c96dca5d-180f-4c14-891f-f5f803754a9b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:05.659116 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c96dca5d-180f-4c14-891f-f5f803754a9b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:05.660459 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c96dca5d-180f-4c14-891f-f5f803754a9b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:05.661232 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c96dca5d-180f-4c14-891f-f5f803754a9b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:05.936412 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-c96dca5d-180f-4c14-891f-f5f803754a9b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:05.950270 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-c96dca5d-180f-4c14-891f-f5f803754a9b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:05.952889 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-c96dca5d-180f-4c14-891f-f5f803754a9b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:05.954461 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-c96dca5d-180f-4c14-891f-f5f803754a9b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1743 microversion: 2.20 time: 0.330226 Oct 28 09:51:05.960482 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 149/298] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:51:05 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1743 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:06.381076 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-4323a23c-8cd6-48c1-9453-eb19dc25ed5f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:06.382756 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-4323a23c-8cd6-48c1-9453-eb19dc25ed5f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:06.395614 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4323a23c-8cd6-48c1-9453-eb19dc25ed5f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:06.396744 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4323a23c-8cd6-48c1-9453-eb19dc25ed5f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:06.398270 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4323a23c-8cd6-48c1-9453-eb19dc25ed5f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:06.399148 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4323a23c-8cd6-48c1-9453-eb19dc25ed5f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:06.475550 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.objects.instance [None req-4323a23c-8cd6-48c1-9453-eb19dc25ed5f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lazy-loading 'flavor' on Instance uuid 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f {{(pid=123068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 09:51:06.852713 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-4323a23c-8cd6-48c1-9453-eb19dc25ed5f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "POST /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f/action" status: 200 len: 32 microversion: 2.1 time: 0.478976 Oct 28 09:51:06.853814 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 150/299] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:51:06 2021] POST /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f/action => generated 32 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:51:06.864363 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-6894bec7-7a98-4bc9-a32b-02c76471c634 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:06.865256 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-6894bec7-7a98-4bc9-a32b-02c76471c634 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:06.882388 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6894bec7-7a98-4bc9-a32b-02c76471c634 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:06.889545 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6894bec7-7a98-4bc9-a32b-02c76471c634 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:06.889545 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6894bec7-7a98-4bc9-a32b-02c76471c634 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:06.889545 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6894bec7-7a98-4bc9-a32b-02c76471c634 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:06.990906 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-c6b052c1-c212-4a7d-b505-193175330928 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:06.992128 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-c6b052c1-c212-4a7d-b505-193175330928 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:07.026421 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c6b052c1-c212-4a7d-b505-193175330928 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:07.026421 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c6b052c1-c212-4a7d-b505-193175330928 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:07.026421 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c6b052c1-c212-4a7d-b505-193175330928 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:07.026421 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c6b052c1-c212-4a7d-b505-193175330928 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:07.782815 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-6894bec7-7a98-4bc9-a32b-02c76471c634 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:07.835762 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-6894bec7-7a98-4bc9-a32b-02c76471c634 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1527 microversion: 2.1 time: 0.974694 Oct 28 09:51:07.870211 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 150/300] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:06 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1527 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:51:08.057827 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-c6b052c1-c212-4a7d-b505-193175330928 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:08.069394 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-c6b052c1-c212-4a7d-b505-193175330928 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:08.072065 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-c6b052c1-c212-4a7d-b505-193175330928 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:08.077689 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-c6b052c1-c212-4a7d-b505-193175330928 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1743 microversion: 2.20 time: 1.097765 Oct 28 09:51:08.089524 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 151/301] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:51:06 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1743 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:08.902603 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-20e0f907-dfbe-4c7a-bff8-0016d6bd1869 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:08.903673 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-20e0f907-dfbe-4c7a-bff8-0016d6bd1869 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:08.915980 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-20e0f907-dfbe-4c7a-bff8-0016d6bd1869 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:08.917504 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-20e0f907-dfbe-4c7a-bff8-0016d6bd1869 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:08.918647 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-20e0f907-dfbe-4c7a-bff8-0016d6bd1869 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:08.919347 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-20e0f907-dfbe-4c7a-bff8-0016d6bd1869 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:09.103164 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-7f09b754-811c-4433-a2f4-2e006ee7702d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:09.104344 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-7f09b754-811c-4433-a2f4-2e006ee7702d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:09.120209 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7f09b754-811c-4433-a2f4-2e006ee7702d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:09.120645 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7f09b754-811c-4433-a2f4-2e006ee7702d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:09.121661 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7f09b754-811c-4433-a2f4-2e006ee7702d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:09.122245 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7f09b754-811c-4433-a2f4-2e006ee7702d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:09.128824 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-20e0f907-dfbe-4c7a-bff8-0016d6bd1869 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:09.137969 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-20e0f907-dfbe-4c7a-bff8-0016d6bd1869 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1527 microversion: 2.1 time: 0.253882 Oct 28 09:51:09.141116 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 151/302] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:08 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1527 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:09.293612 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-7f09b754-811c-4433-a2f4-2e006ee7702d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:09.302228 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-7f09b754-811c-4433-a2f4-2e006ee7702d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:09.303715 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-7f09b754-811c-4433-a2f4-2e006ee7702d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:09.304952 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-7f09b754-811c-4433-a2f4-2e006ee7702d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1743 microversion: 2.20 time: 0.207561 Oct 28 09:51:09.305503 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 152/303] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:51:09 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1743 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:51:10.158681 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-7949aacc-7b5d-4dc2-bdff-794e622ec04c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:10.159439 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-7949aacc-7b5d-4dc2-bdff-794e622ec04c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:10.166138 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7949aacc-7b5d-4dc2-bdff-794e622ec04c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:10.166586 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7949aacc-7b5d-4dc2-bdff-794e622ec04c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:10.167414 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7949aacc-7b5d-4dc2-bdff-794e622ec04c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:10.167847 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7949aacc-7b5d-4dc2-bdff-794e622ec04c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:10.326017 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-62d4954d-912a-402a-9c34-d357f84fa827 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:10.327361 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-62d4954d-912a-402a-9c34-d357f84fa827 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:10.335120 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-62d4954d-912a-402a-9c34-d357f84fa827 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:10.335799 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-62d4954d-912a-402a-9c34-d357f84fa827 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:10.336739 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-62d4954d-912a-402a-9c34-d357f84fa827 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:10.338678 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-62d4954d-912a-402a-9c34-d357f84fa827 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:10.352492 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-7949aacc-7b5d-4dc2-bdff-794e622ec04c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:10.364551 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-7949aacc-7b5d-4dc2-bdff-794e622ec04c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1527 microversion: 2.1 time: 0.209443 Oct 28 09:51:10.365336 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 152/304] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:10 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1527 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:10.578250 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-62d4954d-912a-402a-9c34-d357f84fa827 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:10.588691 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-62d4954d-912a-402a-9c34-d357f84fa827 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:10.590871 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-62d4954d-912a-402a-9c34-d357f84fa827 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:10.592179 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-62d4954d-912a-402a-9c34-d357f84fa827 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1743 microversion: 2.20 time: 0.271416 Oct 28 09:51:10.606814 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 153/305] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:51:10 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1743 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:11.392124 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-30309f0b-d677-4117-abea-69e810f335be tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:11.393241 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-30309f0b-d677-4117-abea-69e810f335be tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:11.408307 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-30309f0b-d677-4117-abea-69e810f335be tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:11.409144 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-30309f0b-d677-4117-abea-69e810f335be tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:11.410047 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-30309f0b-d677-4117-abea-69e810f335be tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:11.410583 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-30309f0b-d677-4117-abea-69e810f335be tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:11.612231 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-31486e0f-5e40-42a2-a0dc-1f4a5bd9e305 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:11.613144 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-31486e0f-5e40-42a2-a0dc-1f4a5bd9e305 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:11.624419 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-31486e0f-5e40-42a2-a0dc-1f4a5bd9e305 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:11.624889 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-31486e0f-5e40-42a2-a0dc-1f4a5bd9e305 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:11.625772 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-31486e0f-5e40-42a2-a0dc-1f4a5bd9e305 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:11.626196 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-31486e0f-5e40-42a2-a0dc-1f4a5bd9e305 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:11.701430 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-30309f0b-d677-4117-abea-69e810f335be tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:11.729072 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-30309f0b-d677-4117-abea-69e810f335be tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1527 microversion: 2.1 time: 0.339630 Oct 28 09:51:11.746031 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 153/306] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:11 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1527 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:11.921563 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-31486e0f-5e40-42a2-a0dc-1f4a5bd9e305 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:11.923460 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-59ba9afb-8d30-4377-b30c-9c79b3d0e7c8 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Action: 'create', calling method: .version_select at 0x7fe1217405e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1910483775"}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:11.951591 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-31486e0f-5e40-42a2-a0dc-1f4a5bd9e305 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:11.951591 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-31486e0f-5e40-42a2-a0dc-1f4a5bd9e305 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:11.951591 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-31486e0f-5e40-42a2-a0dc-1f4a5bd9e305 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1743 microversion: 2.20 time: 0.335528 Oct 28 09:51:11.951948 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 154/307] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:51:11 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1743 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:51:11.956433 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.quota [None req-59ba9afb-8d30-4377-b30c-9c79b3d0e7c8 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Getting quotas for project 811afb17ee044ea7a3d2f22cd0a9d5e1. Resources: {'key_pairs'} {{(pid=123069) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 09:51:11.970855 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.quota [None req-59ba9afb-8d30-4377-b30c-9c79b3d0e7c8 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Getting quotas for user 5d043c131f1c41fdb9b1ee94558f914e and project 811afb17ee044ea7a3d2f22cd0a9d5e1. Resources: {'key_pairs'} {{(pid=123069) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 09:51:12.273430 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.quota [None req-59ba9afb-8d30-4377-b30c-9c79b3d0e7c8 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Getting quotas for project 811afb17ee044ea7a3d2f22cd0a9d5e1. Resources: {'key_pairs'} {{(pid=123069) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 09:51:12.279295 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.quota [None req-59ba9afb-8d30-4377-b30c-9c79b3d0e7c8 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Getting quotas for user 5d043c131f1c41fdb9b1ee94558f914e and project 811afb17ee044ea7a3d2f22cd0a9d5e1. Resources: {'key_pairs'} {{(pid=123069) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 09:51:12.354003 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-59ba9afb-8d30-4377-b30c-9c79b3d0e7c8 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.454327 Oct 28 09:51:12.359752 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 154/308] 10.222.0.104 () {60 vars in 1162 bytes} [Thu Oct 28 09:51:11 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:12.469087 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-45438ba8-1ee4-4ad3-a6ae-5eb0e020dca7 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-979735803", "imageRef": "ccac6c3e-9d8c-4f03-bc9f-856a572907be", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1910483775", "networks": [{"uuid": "eae02c1e-9b55-4706-835b-6fa51061835a"}]}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:12.579593 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.network.neutron [None req-45438ba8-1ee4-4ad3-a6ae-5eb0e020dca7 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] validate_networks() for [('eae02c1e-9b55-4706-835b-6fa51061835a', None, None, None, None, None)] {{(pid=123068) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 09:51:12.757029 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-f2695b97-d833-4cd9-a69e-3c01af65c7c1 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:12.762411 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-f2695b97-d833-4cd9-a69e-3c01af65c7c1 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:12.774283 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f2695b97-d833-4cd9-a69e-3c01af65c7c1 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:12.776420 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f2695b97-d833-4cd9-a69e-3c01af65c7c1 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:12.778285 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f2695b97-d833-4cd9-a69e-3c01af65c7c1 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:12.791223 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f2695b97-d833-4cd9-a69e-3c01af65c7c1 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:13.081681 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-f2695b97-d833-4cd9-a69e-3c01af65c7c1 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:13.095943 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-f2695b97-d833-4cd9-a69e-3c01af65c7c1 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1527 microversion: 2.1 time: 0.347434 Oct 28 09:51:13.102677 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 155/309] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:12 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1527 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:51:13.108164 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-8ba4f93e-273e-45c1-9147-2bba8d6af834 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:13.113782 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-8ba4f93e-273e-45c1-9147-2bba8d6af834 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:13.129101 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8ba4f93e-273e-45c1-9147-2bba8d6af834 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:13.129851 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8ba4f93e-273e-45c1-9147-2bba8d6af834 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:13.131111 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8ba4f93e-273e-45c1-9147-2bba8d6af834 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:13.131703 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8ba4f93e-273e-45c1-9147-2bba8d6af834 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:13.625753 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-45438ba8-1ee4-4ad3-a6ae-5eb0e020dca7 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Flavor limits 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:51:13.627993 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-45438ba8-1ee4-4ad3-a6ae-5eb0e020dca7 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Image limits 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:51:13.628871 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-45438ba8-1ee4-4ad3-a6ae-5eb0e020dca7 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Flavor pref 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:51:13.629634 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-45438ba8-1ee4-4ad3-a6ae-5eb0e020dca7 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Image pref 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:51:13.630283 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-45438ba8-1ee4-4ad3-a6ae-5eb0e020dca7 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:51:13.642175 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-45438ba8-1ee4-4ad3-a6ae-5eb0e020dca7 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:13.643168 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-45438ba8-1ee4-4ad3-a6ae-5eb0e020dca7 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:13.644203 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-45438ba8-1ee4-4ad3-a6ae-5eb0e020dca7 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:13.644901 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-45438ba8-1ee4-4ad3-a6ae-5eb0e020dca7 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:13.664170 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.quota [None req-45438ba8-1ee4-4ad3-a6ae-5eb0e020dca7 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Getting quotas for project 811afb17ee044ea7a3d2f22cd0a9d5e1. Resources: {'ram', 'cores', 'instances'} {{(pid=123068) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 09:51:13.668731 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.quota [None req-45438ba8-1ee4-4ad3-a6ae-5eb0e020dca7 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Getting quotas for user 5d043c131f1c41fdb9b1ee94558f914e and project 811afb17ee044ea7a3d2f22cd0a9d5e1. Resources: {'ram', 'cores', 'instances'} {{(pid=123068) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 09:51:13.675590 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-8ba4f93e-273e-45c1-9147-2bba8d6af834 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:13.682425 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-45438ba8-1ee4-4ad3-a6ae-5eb0e020dca7 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Going to run 1 instances... {{(pid=123068) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 09:51:13.685173 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-45438ba8-1ee4-4ad3-a6ae-5eb0e020dca7 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ccac6c3e-9d8c-4f03-bc9f-856a572907be',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 09:51:13.685680 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-8ba4f93e-273e-45c1-9147-2bba8d6af834 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:13.687255 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-8ba4f93e-273e-45c1-9147-2bba8d6af834 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:13.688452 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-8ba4f93e-273e-45c1-9147-2bba8d6af834 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1743 microversion: 2.20 time: 0.584089 Oct 28 09:51:13.700888 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 156/310] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:51:13 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1743 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:13.822264 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-45438ba8-1ee4-4ad3-a6ae-5eb0e020dca7 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.365802 Oct 28 09:51:13.824762 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 155/311] 10.222.0.104 () {60 vars in 1151 bytes} [Thu Oct 28 09:51:12 2021] POST /compute/v2.1/servers => generated 382 bytes in 1369 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 28 09:51:13.835976 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-0765f516-cade-47d9-88cd-8ea841801d28 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:13.836948 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-0765f516-cade-47d9-88cd-8ea841801d28 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:13.906971 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-0765f516-cade-47d9-88cd-8ea841801d28 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:13.916901 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-0765f516-cade-47d9-88cd-8ea841801d28 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1262 microversion: 2.1 time: 0.083081 Oct 28 09:51:13.927381 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 157/312] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:13 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1262 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:14.124770 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-3d6b9a55-72a3-4bb5-9ec4-0dff6d0848b9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:14.125665 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-3d6b9a55-72a3-4bb5-9ec4-0dff6d0848b9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:14.136626 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3d6b9a55-72a3-4bb5-9ec4-0dff6d0848b9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:14.137674 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3d6b9a55-72a3-4bb5-9ec4-0dff6d0848b9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:14.139645 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3d6b9a55-72a3-4bb5-9ec4-0dff6d0848b9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:14.140605 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3d6b9a55-72a3-4bb5-9ec4-0dff6d0848b9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:14.316850 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-3d6b9a55-72a3-4bb5-9ec4-0dff6d0848b9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:14.328273 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-3d6b9a55-72a3-4bb5-9ec4-0dff6d0848b9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1527 microversion: 2.1 time: 0.208277 Oct 28 09:51:14.328921 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 156/313] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:14 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1527 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:14.709419 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-7fcdef82-28e8-44ae-9682-57272a0e8822 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:14.709917 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-7fcdef82-28e8-44ae-9682-57272a0e8822 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:14.716685 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7fcdef82-28e8-44ae-9682-57272a0e8822 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:14.717116 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7fcdef82-28e8-44ae-9682-57272a0e8822 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:14.717896 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7fcdef82-28e8-44ae-9682-57272a0e8822 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:14.718315 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7fcdef82-28e8-44ae-9682-57272a0e8822 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:14.850500 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-7fcdef82-28e8-44ae-9682-57272a0e8822 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:14.859927 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-7fcdef82-28e8-44ae-9682-57272a0e8822 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:14.861482 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-7fcdef82-28e8-44ae-9682-57272a0e8822 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:14.862656 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-7fcdef82-28e8-44ae-9682-57272a0e8822 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1743 microversion: 2.20 time: 0.157164 Oct 28 09:51:14.863258 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 158/314] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:51:14 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:51:14.934979 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-da9431b3-11b4-405a-987e-6552c87daed5 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:14.935604 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-da9431b3-11b4-405a-987e-6552c87daed5 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:15.000323 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-da9431b3-11b4-405a-987e-6552c87daed5 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:15.011494 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-da9431b3-11b4-405a-987e-6552c87daed5 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1262 microversion: 2.1 time: 0.080030 Oct 28 09:51:15.012645 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 157/315] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:14 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:15.348040 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-1af8456c-08b7-4ed1-af17-4730cdddab71 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:15.348811 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-1af8456c-08b7-4ed1-af17-4730cdddab71 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:15.356314 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1af8456c-08b7-4ed1-af17-4730cdddab71 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:15.357343 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1af8456c-08b7-4ed1-af17-4730cdddab71 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:15.358195 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1af8456c-08b7-4ed1-af17-4730cdddab71 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:15.358710 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1af8456c-08b7-4ed1-af17-4730cdddab71 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:15.549276 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-1af8456c-08b7-4ed1-af17-4730cdddab71 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:15.561548 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-1af8456c-08b7-4ed1-af17-4730cdddab71 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1527 microversion: 2.1 time: 0.218003 Oct 28 09:51:15.584577 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 159/316] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:15 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1527 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:51:15.886690 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-5c20c87c-f325-439a-a0fd-1a8157b7a779 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:15.888229 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-5c20c87c-f325-439a-a0fd-1a8157b7a779 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:15.897077 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5c20c87c-f325-439a-a0fd-1a8157b7a779 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:15.898480 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5c20c87c-f325-439a-a0fd-1a8157b7a779 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:15.900171 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5c20c87c-f325-439a-a0fd-1a8157b7a779 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:15.901105 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5c20c87c-f325-439a-a0fd-1a8157b7a779 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:16.037113 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-09cb2140-0a35-48f3-9f18-1cbc3a38b689 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:16.037718 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-09cb2140-0a35-48f3-9f18-1cbc3a38b689 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:16.118654 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-09cb2140-0a35-48f3-9f18-1cbc3a38b689 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:16.128267 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-09cb2140-0a35-48f3-9f18-1cbc3a38b689 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1262 microversion: 2.1 time: 0.096206 Oct 28 09:51:16.135824 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 160/317] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:16 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1262 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:51:16.138991 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-5c20c87c-f325-439a-a0fd-1a8157b7a779 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:16.148080 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-5c20c87c-f325-439a-a0fd-1a8157b7a779 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:16.149724 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-5c20c87c-f325-439a-a0fd-1a8157b7a779 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:16.155560 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-5c20c87c-f325-439a-a0fd-1a8157b7a779 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1743 microversion: 2.20 time: 0.275707 Oct 28 09:51:16.156361 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 158/318] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:51:15 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1743 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:16.586076 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-1ebae1f5-8098-4c3b-92e6-b4d333d7b75f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:16.587307 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-1ebae1f5-8098-4c3b-92e6-b4d333d7b75f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:16.594544 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1ebae1f5-8098-4c3b-92e6-b4d333d7b75f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:16.595007 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1ebae1f5-8098-4c3b-92e6-b4d333d7b75f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:16.595893 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1ebae1f5-8098-4c3b-92e6-b4d333d7b75f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:16.596267 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1ebae1f5-8098-4c3b-92e6-b4d333d7b75f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:16.744178 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-1ebae1f5-8098-4c3b-92e6-b4d333d7b75f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:16.752740 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-1ebae1f5-8098-4c3b-92e6-b4d333d7b75f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1527 microversion: 2.1 time: 0.172848 Oct 28 09:51:16.753329 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 161/319] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:16 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1527 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:51:17.152588 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-dcac1bde-4f6b-4789-ae69-7ca642314599 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:17.153692 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-dcac1bde-4f6b-4789-ae69-7ca642314599 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:17.161646 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-dcac1bde-4f6b-4789-ae69-7ca642314599 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:17.161646 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-dcac1bde-4f6b-4789-ae69-7ca642314599 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:17.162511 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-dcac1bde-4f6b-4789-ae69-7ca642314599 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:17.162792 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-dcac1bde-4f6b-4789-ae69-7ca642314599 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:17.175687 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-2a3ccd81-af73-483b-a8ad-d548e3a5e815 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:17.176326 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-2a3ccd81-af73-483b-a8ad-d548e3a5e815 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:17.185043 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2a3ccd81-af73-483b-a8ad-d548e3a5e815 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:17.185570 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2a3ccd81-af73-483b-a8ad-d548e3a5e815 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:17.186611 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2a3ccd81-af73-483b-a8ad-d548e3a5e815 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:17.187081 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2a3ccd81-af73-483b-a8ad-d548e3a5e815 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:17.234525 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-dcac1bde-4f6b-4789-ae69-7ca642314599 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:17.242550 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-dcac1bde-4f6b-4789-ae69-7ca642314599 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1314 microversion: 2.1 time: 0.094733 Oct 28 09:51:17.244122 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 159/320] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:17 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1314 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:17.332046 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-2a3ccd81-af73-483b-a8ad-d548e3a5e815 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:17.341285 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-2a3ccd81-af73-483b-a8ad-d548e3a5e815 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:17.342837 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-2a3ccd81-af73-483b-a8ad-d548e3a5e815 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:17.344020 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-2a3ccd81-af73-483b-a8ad-d548e3a5e815 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1743 microversion: 2.20 time: 0.172650 Oct 28 09:51:17.344590 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 162/321] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:51:17 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1743 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:51:17.772572 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-094ccb03-03a8-45a1-9971-3788c42b6e4c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:17.774966 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-094ccb03-03a8-45a1-9971-3788c42b6e4c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:17.781558 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-094ccb03-03a8-45a1-9971-3788c42b6e4c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:17.781989 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-094ccb03-03a8-45a1-9971-3788c42b6e4c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:17.782789 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-094ccb03-03a8-45a1-9971-3788c42b6e4c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:17.783222 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-094ccb03-03a8-45a1-9971-3788c42b6e4c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:18.020056 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-094ccb03-03a8-45a1-9971-3788c42b6e4c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:18.031158 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-094ccb03-03a8-45a1-9971-3788c42b6e4c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1527 microversion: 2.1 time: 0.262983 Oct 28 09:51:18.035803 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 160/322] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:17 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1527 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:51:18.265242 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-715c5492-817c-43f1-9fd8-c05727cf8c7d tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:18.265825 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-715c5492-817c-43f1-9fd8-c05727cf8c7d tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:18.273840 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-715c5492-817c-43f1-9fd8-c05727cf8c7d tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:18.274620 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-715c5492-817c-43f1-9fd8-c05727cf8c7d tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:18.275554 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-715c5492-817c-43f1-9fd8-c05727cf8c7d tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:18.280225 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-715c5492-817c-43f1-9fd8-c05727cf8c7d tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:18.366293 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-715c5492-817c-43f1-9fd8-c05727cf8c7d tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:18.366690 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-d0db0f6b-4095-4feb-a1f3-c0ec6795b29f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:18.366690 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-d0db0f6b-4095-4feb-a1f3-c0ec6795b29f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:18.372976 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-715c5492-817c-43f1-9fd8-c05727cf8c7d tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1322 microversion: 2.1 time: 0.113618 Oct 28 09:51:18.374199 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 163/323] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:18 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1322 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:51:18.382543 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d0db0f6b-4095-4feb-a1f3-c0ec6795b29f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:18.384141 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d0db0f6b-4095-4feb-a1f3-c0ec6795b29f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:18.385013 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d0db0f6b-4095-4feb-a1f3-c0ec6795b29f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:18.385455 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d0db0f6b-4095-4feb-a1f3-c0ec6795b29f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:18.576415 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-d0db0f6b-4095-4feb-a1f3-c0ec6795b29f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:18.584823 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-d0db0f6b-4095-4feb-a1f3-c0ec6795b29f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:18.586323 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-d0db0f6b-4095-4feb-a1f3-c0ec6795b29f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:18.588727 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-d0db0f6b-4095-4feb-a1f3-c0ec6795b29f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1725 microversion: 2.20 time: 0.228221 Oct 28 09:51:18.589311 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 161/324] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:51:18 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1725 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:19.058830 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-50394758-9608-4c89-ba63-80d99777281a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:19.060032 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-50394758-9608-4c89-ba63-80d99777281a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:19.083164 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-50394758-9608-4c89-ba63-80d99777281a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:19.083982 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-50394758-9608-4c89-ba63-80d99777281a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:19.085792 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-50394758-9608-4c89-ba63-80d99777281a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:19.086663 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-50394758-9608-4c89-ba63-80d99777281a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:19.313346 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-50394758-9608-4c89-ba63-80d99777281a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:19.325035 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-50394758-9608-4c89-ba63-80d99777281a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1527 microversion: 2.1 time: 0.274837 Oct 28 09:51:19.325870 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 164/325] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:19 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1527 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:19.391091 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-cf2ba553-b031-47d8-85a9-8dbbd9e0b11e tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:19.391612 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-cf2ba553-b031-47d8-85a9-8dbbd9e0b11e tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:19.398062 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cf2ba553-b031-47d8-85a9-8dbbd9e0b11e tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:19.398671 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cf2ba553-b031-47d8-85a9-8dbbd9e0b11e tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:19.400812 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cf2ba553-b031-47d8-85a9-8dbbd9e0b11e tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:19.401428 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cf2ba553-b031-47d8-85a9-8dbbd9e0b11e tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:19.538538 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-cf2ba553-b031-47d8-85a9-8dbbd9e0b11e tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:19.547987 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-cf2ba553-b031-47d8-85a9-8dbbd9e0b11e tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1362 microversion: 2.1 time: 0.160563 Oct 28 09:51:19.548567 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 162/326] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:19 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:19.607758 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-d902762d-44e6-4556-b174-2fd042587840 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:19.608349 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-d902762d-44e6-4556-b174-2fd042587840 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:19.614777 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d902762d-44e6-4556-b174-2fd042587840 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:19.615014 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d902762d-44e6-4556-b174-2fd042587840 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:19.615797 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d902762d-44e6-4556-b174-2fd042587840 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:19.616218 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d902762d-44e6-4556-b174-2fd042587840 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:19.754237 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-d902762d-44e6-4556-b174-2fd042587840 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:19.763906 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-d902762d-44e6-4556-b174-2fd042587840 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:19.765579 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-d902762d-44e6-4556-b174-2fd042587840 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:19.766827 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-d902762d-44e6-4556-b174-2fd042587840 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1725 microversion: 2.20 time: 0.162818 Oct 28 09:51:19.767458 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 165/327] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:51:19 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:20.348591 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-50e2902c-8b50-46ee-9bfd-912a2b4de5ca tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:20.348591 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-50e2902c-8b50-46ee-9bfd-912a2b4de5ca tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:20.353979 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-50e2902c-8b50-46ee-9bfd-912a2b4de5ca tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:20.354436 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-50e2902c-8b50-46ee-9bfd-912a2b4de5ca tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:20.355222 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-50e2902c-8b50-46ee-9bfd-912a2b4de5ca tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:20.355648 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-50e2902c-8b50-46ee-9bfd-912a2b4de5ca tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:20.520191 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-50e2902c-8b50-46ee-9bfd-912a2b4de5ca tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:20.532849 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-50e2902c-8b50-46ee-9bfd-912a2b4de5ca tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1527 microversion: 2.1 time: 0.191690 Oct 28 09:51:20.533900 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 163/328] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:20 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1527 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:20.563672 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [req-2ffc4dfc-4f35-4890-8b1a-84b9b6f60c41 req-60481b13-4396-49cc-8e3c-3eb6840d2e20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b49b31e1-36d8-4096-a5fc-b2d46ef922eb", "name": "network-vif-unplugged", "status": "completed", "tag": "b51e7b00-09ad-41ca-b851-00805473b75a"}]} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:20.564993 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:51:20.564993 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 09:51:20.566143 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-d6a8df78-2663-4050-80ee-6be3e9da7156 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:20.566908 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-d6a8df78-2663-4050-80ee-6be3e9da7156 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:20.573831 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d6a8df78-2663-4050-80ee-6be3e9da7156 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:20.574502 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d6a8df78-2663-4050-80ee-6be3e9da7156 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:20.576230 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d6a8df78-2663-4050-80ee-6be3e9da7156 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:20.577366 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d6a8df78-2663-4050-80ee-6be3e9da7156 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:20.578727 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-2ffc4dfc-4f35-4890-8b1a-84b9b6f60c41 req-60481b13-4396-49cc-8e3c-3eb6840d2e20 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:20.579858 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-2ffc4dfc-4f35-4890-8b1a-84b9b6f60c41 req-60481b13-4396-49cc-8e3c-3eb6840d2e20 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:20.592593 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.compute.server_external_events [req-2ffc4dfc-4f35-4890-8b1a-84b9b6f60c41 req-60481b13-4396-49cc-8e3c-3eb6840d2e20 service nova] Creating event network-vif-unplugged:b51e7b00-09ad-41ca-b851-00805473b75a for instance b49b31e1-36d8-4096-a5fc-b2d46ef922eb on hv-cinder-81571 Oct 28 09:51:20.598152 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [req-2ffc4dfc-4f35-4890-8b1a-84b9b6f60c41 req-60481b13-4396-49cc-8e3c-3eb6840d2e20 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039105 Oct 28 09:51:20.598747 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 166/329] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:51:20 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:20.722699 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-d6a8df78-2663-4050-80ee-6be3e9da7156 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:20.731456 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-d6a8df78-2663-4050-80ee-6be3e9da7156 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1362 microversion: 2.1 time: 0.168705 Oct 28 09:51:20.733277 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 164/330] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:20 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:51:20.785281 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-eaa40008-df9b-490e-8634-12e6ea53336d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:20.785965 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-eaa40008-df9b-490e-8634-12e6ea53336d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:20.794538 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-eaa40008-df9b-490e-8634-12e6ea53336d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:20.795023 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-eaa40008-df9b-490e-8634-12e6ea53336d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:20.795833 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-eaa40008-df9b-490e-8634-12e6ea53336d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:20.796260 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-eaa40008-df9b-490e-8634-12e6ea53336d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:20.949383 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-eaa40008-df9b-490e-8634-12e6ea53336d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:20.956232 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-eaa40008-df9b-490e-8634-12e6ea53336d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:20.958019 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-eaa40008-df9b-490e-8634-12e6ea53336d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:20.959187 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-eaa40008-df9b-490e-8634-12e6ea53336d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1725 microversion: 2.20 time: 0.178013 Oct 28 09:51:20.959735 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 167/331] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:51:20 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:21.435026 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-a00f7f59-ae27-448b-93e3-028b51ef8cc4 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1137278238", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-359364649", "security_groups": [{"name": "tempest-secgroup-smoke-2005931948"}], "networks": [{"uuid": "539fce33-04b4-4c73-a872-377b5a59acf4"}], "block_device_mapping_v2": [{"uuid": "fcb1e994-ad8f-476c-99cc-c4fec38fe005", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:21.555967 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-5e72b5da-251c-4cb8-a68a-54225bfa5270 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:21.557531 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-5e72b5da-251c-4cb8-a68a-54225bfa5270 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:21.558161 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.network.neutron [None req-a00f7f59-ae27-448b-93e3-028b51ef8cc4 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] validate_networks() for [('539fce33-04b4-4c73-a872-377b5a59acf4', None, None, None, None, None)] {{(pid=123068) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 09:51:21.563471 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5e72b5da-251c-4cb8-a68a-54225bfa5270 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:21.570347 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5e72b5da-251c-4cb8-a68a-54225bfa5270 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:21.580399 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5e72b5da-251c-4cb8-a68a-54225bfa5270 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:21.580800 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5e72b5da-251c-4cb8-a68a-54225bfa5270 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:21.801701 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-5e72b5da-251c-4cb8-a68a-54225bfa5270 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:21.812579 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-5e72b5da-251c-4cb8-a68a-54225bfa5270 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1527 microversion: 2.1 time: 0.265595 Oct 28 09:51:21.813210 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 168/332] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:21 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1527 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:21.817873 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-2b1c08da-23c6-4661-bba5-4f3127a65bb1 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:21.818653 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-2b1c08da-23c6-4661-bba5-4f3127a65bb1 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:21.825356 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2b1c08da-23c6-4661-bba5-4f3127a65bb1 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:21.825792 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2b1c08da-23c6-4661-bba5-4f3127a65bb1 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:21.826562 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2b1c08da-23c6-4661-bba5-4f3127a65bb1 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:21.826985 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2b1c08da-23c6-4661-bba5-4f3127a65bb1 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:22.096555 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-2b1c08da-23c6-4661-bba5-4f3127a65bb1 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:22.103937 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-2b1c08da-23c6-4661-bba5-4f3127a65bb1 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1362 microversion: 2.1 time: 0.289413 Oct 28 09:51:22.104605 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 169/333] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:21 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1362 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:22.109652 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-610bf9a7-9fd4-41a6-9a82-e21191c67126 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:22.110482 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-610bf9a7-9fd4-41a6-9a82-e21191c67126 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:22.119929 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-610bf9a7-9fd4-41a6-9a82-e21191c67126 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:22.124637 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-610bf9a7-9fd4-41a6-9a82-e21191c67126 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:22.125331 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-610bf9a7-9fd4-41a6-9a82-e21191c67126 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:22.125884 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-610bf9a7-9fd4-41a6-9a82-e21191c67126 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:22.160014 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-a00f7f59-ae27-448b-93e3-028b51ef8cc4 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Flavor limits 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:51:22.160443 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-a00f7f59-ae27-448b-93e3-028b51ef8cc4 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Image limits 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:51:22.160945 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-a00f7f59-ae27-448b-93e3-028b51ef8cc4 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Flavor pref 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:51:22.161358 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-a00f7f59-ae27-448b-93e3-028b51ef8cc4 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Image pref 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:51:22.161779 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-a00f7f59-ae27-448b-93e3-028b51ef8cc4 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:51:22.171880 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a00f7f59-ae27-448b-93e3-028b51ef8cc4 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:22.205091 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a00f7f59-ae27-448b-93e3-028b51ef8cc4 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:22.205091 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a00f7f59-ae27-448b-93e3-028b51ef8cc4 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:22.205091 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a00f7f59-ae27-448b-93e3-028b51ef8cc4 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:22.205091 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.quota [None req-a00f7f59-ae27-448b-93e3-028b51ef8cc4 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Getting quotas for project 8171734427fe4b4bb14d52d4d336a76b. Resources: {'ram', 'cores', 'instances'} {{(pid=123068) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 09:51:22.205517 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.quota [None req-a00f7f59-ae27-448b-93e3-028b51ef8cc4 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Getting quotas for user 9859c6302ddc418da07047bf02603788 and project 8171734427fe4b4bb14d52d4d336a76b. Resources: {'ram', 'cores', 'instances'} {{(pid=123068) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 09:51:22.338654 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-a00f7f59-ae27-448b-93e3-028b51ef8cc4 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Going to run 1 instances... {{(pid=123068) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 09:51:22.338654 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-a00f7f59-ae27-448b-93e3-028b51ef8cc4 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fcb1e994-ad8f-476c-99cc-c4fec38fe005',volume_size=None,volume_type=None)] {{(pid=123068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 09:51:22.338883 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-610bf9a7-9fd4-41a6-9a82-e21191c67126 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:22.338883 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-610bf9a7-9fd4-41a6-9a82-e21191c67126 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:22.339085 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-610bf9a7-9fd4-41a6-9a82-e21191c67126 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:22.339085 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-610bf9a7-9fd4-41a6-9a82-e21191c67126 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1725 microversion: 2.20 time: 0.205941 Oct 28 09:51:22.339085 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 170/334] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:51:22 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1725 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:22.830226 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-b7abfe34-2b4b-433f-84c7-61743d6bd1da tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:22.832028 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-b7abfe34-2b4b-433f-84c7-61743d6bd1da tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:22.849886 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b7abfe34-2b4b-433f-84c7-61743d6bd1da tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:22.849886 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b7abfe34-2b4b-433f-84c7-61743d6bd1da tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:22.849886 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b7abfe34-2b4b-433f-84c7-61743d6bd1da tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:22.849886 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b7abfe34-2b4b-433f-84c7-61743d6bd1da tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:22.999323 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-b7abfe34-2b4b-433f-84c7-61743d6bd1da tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:23.007088 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-b7abfe34-2b4b-433f-84c7-61743d6bd1da tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1527 microversion: 2.1 time: 0.180520 Oct 28 09:51:23.015306 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 171/335] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:22 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1527 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:51:23.030595 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-a00f7f59-ae27-448b-93e3-028b51ef8cc4 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.599275 Oct 28 09:51:23.034186 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 165/336] 10.222.0.104 () {60 vars in 1151 bytes} [Thu Oct 28 09:51:21 2021] POST /compute/v2.1/servers => generated 408 bytes in 1601 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 28 09:51:23.043196 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-4171d4b9-4474-4b20-af3c-2b848bcd22fe tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:23.044116 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-4171d4b9-4474-4b20-af3c-2b848bcd22fe tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:23.124387 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-19ebeb76-f1cf-4785-ac3a-50c78a0b22dc tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:23.125518 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-19ebeb76-f1cf-4785-ac3a-50c78a0b22dc tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:23.135026 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-19ebeb76-f1cf-4785-ac3a-50c78a0b22dc tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:23.136395 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-19ebeb76-f1cf-4785-ac3a-50c78a0b22dc tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:23.137723 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-19ebeb76-f1cf-4785-ac3a-50c78a0b22dc tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:23.138505 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-19ebeb76-f1cf-4785-ac3a-50c78a0b22dc tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:23.139133 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-4171d4b9-4474-4b20-af3c-2b848bcd22fe tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:23.151902 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-4171d4b9-4474-4b20-af3c-2b848bcd22fe tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1091 microversion: 2.1 time: 0.112312 Oct 28 09:51:23.162598 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 172/337] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:23 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1091 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:23.326995 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-19ebeb76-f1cf-4785-ac3a-50c78a0b22dc tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:23.336203 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-ad9c040d-a610-40a9-8a3b-dfc643488c03 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:23.336774 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-19ebeb76-f1cf-4785-ac3a-50c78a0b22dc tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1362 microversion: 2.1 time: 0.218501 Oct 28 09:51:23.337128 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-ad9c040d-a610-40a9-8a3b-dfc643488c03 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:23.337825 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 166/338] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:23 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:23.344456 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ad9c040d-a610-40a9-8a3b-dfc643488c03 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:23.344920 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ad9c040d-a610-40a9-8a3b-dfc643488c03 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:23.345702 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ad9c040d-a610-40a9-8a3b-dfc643488c03 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:23.346134 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ad9c040d-a610-40a9-8a3b-dfc643488c03 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:23.486122 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-ad9c040d-a610-40a9-8a3b-dfc643488c03 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:23.494988 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-ad9c040d-a610-40a9-8a3b-dfc643488c03 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:23.496869 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-ad9c040d-a610-40a9-8a3b-dfc643488c03 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:23.498204 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-ad9c040d-a610-40a9-8a3b-dfc643488c03 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1725 microversion: 2.20 time: 0.166101 Oct 28 09:51:23.499214 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 173/339] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:51:23 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:24.026813 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-05a33143-8767-4231-a9f8-ecf9032b1bab tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:24.027828 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-05a33143-8767-4231-a9f8-ecf9032b1bab tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:24.035215 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-05a33143-8767-4231-a9f8-ecf9032b1bab tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:24.036461 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-05a33143-8767-4231-a9f8-ecf9032b1bab tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:24.037301 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-05a33143-8767-4231-a9f8-ecf9032b1bab tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:24.037744 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-05a33143-8767-4231-a9f8-ecf9032b1bab tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:24.171229 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-6101001c-ec41-404f-b6e3-2a32aa4c1bd3 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:24.171942 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-6101001c-ec41-404f-b6e3-2a32aa4c1bd3 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:24.177238 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-05a33143-8767-4231-a9f8-ecf9032b1bab tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:24.185891 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-05a33143-8767-4231-a9f8-ecf9032b1bab tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1527 microversion: 2.1 time: 0.163354 Oct 28 09:51:24.186795 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 167/340] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:24 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1527 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:24.255484 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-6101001c-ec41-404f-b6e3-2a32aa4c1bd3 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:24.268833 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-6101001c-ec41-404f-b6e3-2a32aa4c1bd3 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1091 microversion: 2.1 time: 0.101178 Oct 28 09:51:24.269626 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 174/341] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:24 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1091 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:24.356798 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-c7aa4add-1796-40a9-a020-437af8a151a3 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:24.357699 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-c7aa4add-1796-40a9-a020-437af8a151a3 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:24.364002 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c7aa4add-1796-40a9-a020-437af8a151a3 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:24.366726 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c7aa4add-1796-40a9-a020-437af8a151a3 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:24.366726 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c7aa4add-1796-40a9-a020-437af8a151a3 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:24.366726 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c7aa4add-1796-40a9-a020-437af8a151a3 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:24.517959 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-c7aa4add-1796-40a9-a020-437af8a151a3 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:24.525591 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-75209986-adb4-45aa-ad86-a41606b1ff1d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:24.526568 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-75209986-adb4-45aa-ad86-a41606b1ff1d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:24.534519 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-75209986-adb4-45aa-ad86-a41606b1ff1d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:24.537277 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-c7aa4add-1796-40a9-a020-437af8a151a3 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1362 microversion: 2.1 time: 0.186728 Oct 28 09:51:24.537883 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 168/342] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:24 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:24.538394 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-75209986-adb4-45aa-ad86-a41606b1ff1d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:24.539207 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-75209986-adb4-45aa-ad86-a41606b1ff1d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:24.540629 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-75209986-adb4-45aa-ad86-a41606b1ff1d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:24.686022 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-75209986-adb4-45aa-ad86-a41606b1ff1d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:24.694504 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-75209986-adb4-45aa-ad86-a41606b1ff1d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:24.696629 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-75209986-adb4-45aa-ad86-a41606b1ff1d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:24.698170 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-75209986-adb4-45aa-ad86-a41606b1ff1d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1725 microversion: 2.20 time: 0.184541 Oct 28 09:51:24.698906 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 175/343] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:51:24 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:51:25.204841 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-99ad2f9c-7778-400d-a83b-c3d416bdd429 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:25.207425 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-99ad2f9c-7778-400d-a83b-c3d416bdd429 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:25.213647 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-99ad2f9c-7778-400d-a83b-c3d416bdd429 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:25.214197 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-99ad2f9c-7778-400d-a83b-c3d416bdd429 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:25.215060 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-99ad2f9c-7778-400d-a83b-c3d416bdd429 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:25.215407 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-99ad2f9c-7778-400d-a83b-c3d416bdd429 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:25.285969 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-9c540a40-f017-4e8f-8fb1-472593586ee4 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:25.286633 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-9c540a40-f017-4e8f-8fb1-472593586ee4 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:25.293429 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9c540a40-f017-4e8f-8fb1-472593586ee4 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:25.293866 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9c540a40-f017-4e8f-8fb1-472593586ee4 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:25.294630 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9c540a40-f017-4e8f-8fb1-472593586ee4 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:25.295050 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9c540a40-f017-4e8f-8fb1-472593586ee4 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:25.359533 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-9c540a40-f017-4e8f-8fb1-472593586ee4 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:25.367365 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-9c540a40-f017-4e8f-8fb1-472593586ee4 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1141 microversion: 2.1 time: 0.085043 Oct 28 09:51:25.368098 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 176/344] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:25 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1141 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:25.372885 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-99ad2f9c-7778-400d-a83b-c3d416bdd429 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:25.380710 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-99ad2f9c-7778-400d-a83b-c3d416bdd429 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1527 microversion: 2.1 time: 0.179776 Oct 28 09:51:25.381291 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 169/345] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:25 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1527 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:25.554709 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-316fcc41-5736-40f0-a4ab-f72460b163ba tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:25.556609 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-316fcc41-5736-40f0-a4ab-f72460b163ba tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:25.564121 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-316fcc41-5736-40f0-a4ab-f72460b163ba tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:25.564560 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-316fcc41-5736-40f0-a4ab-f72460b163ba tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:25.565370 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-316fcc41-5736-40f0-a4ab-f72460b163ba tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:25.565802 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-316fcc41-5736-40f0-a4ab-f72460b163ba tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:25.703285 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-316fcc41-5736-40f0-a4ab-f72460b163ba tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:25.713269 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-316fcc41-5736-40f0-a4ab-f72460b163ba tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1362 microversion: 2.1 time: 0.161103 Oct 28 09:51:25.721840 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 177/346] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:25 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:25.723194 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-4510b514-4d55-4bd0-bd15-8b67821865bb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:25.723958 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-4510b514-4d55-4bd0-bd15-8b67821865bb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:25.730854 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4510b514-4d55-4bd0-bd15-8b67821865bb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:25.731395 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4510b514-4d55-4bd0-bd15-8b67821865bb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:25.732240 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4510b514-4d55-4bd0-bd15-8b67821865bb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:25.732618 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4510b514-4d55-4bd0-bd15-8b67821865bb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:25.891355 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-4510b514-4d55-4bd0-bd15-8b67821865bb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:25.899517 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-4510b514-4d55-4bd0-bd15-8b67821865bb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:25.902356 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-4510b514-4d55-4bd0-bd15-8b67821865bb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:25.903614 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-4510b514-4d55-4bd0-bd15-8b67821865bb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1725 microversion: 2.20 time: 0.184322 Oct 28 09:51:25.904282 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 170/347] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:51:25 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:51:26.384900 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-4948aa89-84d8-46ac-8cc2-48af371658a5 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:26.385649 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-4948aa89-84d8-46ac-8cc2-48af371658a5 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:26.393296 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4948aa89-84d8-46ac-8cc2-48af371658a5 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:26.393296 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4948aa89-84d8-46ac-8cc2-48af371658a5 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:26.393296 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4948aa89-84d8-46ac-8cc2-48af371658a5 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:26.394066 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4948aa89-84d8-46ac-8cc2-48af371658a5 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:26.398487 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-280bdce9-5902-44bf-bd48-53ba3cf7b015 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:26.400210 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-280bdce9-5902-44bf-bd48-53ba3cf7b015 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:26.410964 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-280bdce9-5902-44bf-bd48-53ba3cf7b015 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:26.411315 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-280bdce9-5902-44bf-bd48-53ba3cf7b015 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:26.413562 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-280bdce9-5902-44bf-bd48-53ba3cf7b015 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:26.413562 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-280bdce9-5902-44bf-bd48-53ba3cf7b015 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:26.486771 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-4948aa89-84d8-46ac-8cc2-48af371658a5 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:26.495827 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-4948aa89-84d8-46ac-8cc2-48af371658a5 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1141 microversion: 2.1 time: 0.114859 Oct 28 09:51:26.496737 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 178/348] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:26 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1141 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:26.577759 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-280bdce9-5902-44bf-bd48-53ba3cf7b015 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:26.586264 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-280bdce9-5902-44bf-bd48-53ba3cf7b015 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1527 microversion: 2.1 time: 0.191250 Oct 28 09:51:26.587574 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 171/349] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:26 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1527 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:51:26.730421 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-368604c8-6d97-4dc6-b155-bf0559b2ef65 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:26.731036 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-368604c8-6d97-4dc6-b155-bf0559b2ef65 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:26.737109 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-368604c8-6d97-4dc6-b155-bf0559b2ef65 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:26.737514 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-368604c8-6d97-4dc6-b155-bf0559b2ef65 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:26.738292 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-368604c8-6d97-4dc6-b155-bf0559b2ef65 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:26.738718 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-368604c8-6d97-4dc6-b155-bf0559b2ef65 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:26.871263 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-368604c8-6d97-4dc6-b155-bf0559b2ef65 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:26.876680 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-368604c8-6d97-4dc6-b155-bf0559b2ef65 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1362 microversion: 2.1 time: 0.150404 Oct 28 09:51:26.877315 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 179/350] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:26 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:26.923597 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-a14db163-1a6f-4067-b928-95b746d3b0d2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:26.924209 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-a14db163-1a6f-4067-b928-95b746d3b0d2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:26.932317 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a14db163-1a6f-4067-b928-95b746d3b0d2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:26.932821 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a14db163-1a6f-4067-b928-95b746d3b0d2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:26.933619 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a14db163-1a6f-4067-b928-95b746d3b0d2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:26.934054 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a14db163-1a6f-4067-b928-95b746d3b0d2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:27.085073 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-a14db163-1a6f-4067-b928-95b746d3b0d2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:27.094423 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-a14db163-1a6f-4067-b928-95b746d3b0d2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:27.096045 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-a14db163-1a6f-4067-b928-95b746d3b0d2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:27.098179 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-a14db163-1a6f-4067-b928-95b746d3b0d2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1725 microversion: 2.20 time: 0.178052 Oct 28 09:51:27.099021 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 172/351] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:51:26 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:27.514308 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-d1fc7687-1677-4b16-a8e6-18d3f116955a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:27.515020 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-d1fc7687-1677-4b16-a8e6-18d3f116955a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:27.522171 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d1fc7687-1677-4b16-a8e6-18d3f116955a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:27.522603 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d1fc7687-1677-4b16-a8e6-18d3f116955a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:27.523385 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d1fc7687-1677-4b16-a8e6-18d3f116955a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:27.523996 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d1fc7687-1677-4b16-a8e6-18d3f116955a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:27.599745 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-d1fc7687-1677-4b16-a8e6-18d3f116955a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:27.606237 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-198c99de-ef41-41e9-8d49-05358c2f615a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:27.606840 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-198c99de-ef41-41e9-8d49-05358c2f615a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:27.609349 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-d1fc7687-1677-4b16-a8e6-18d3f116955a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1141 microversion: 2.1 time: 0.100788 Oct 28 09:51:27.609937 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 180/352] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:27 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1141 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:27.619122 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-198c99de-ef41-41e9-8d49-05358c2f615a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:27.619832 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-198c99de-ef41-41e9-8d49-05358c2f615a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:27.621265 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-198c99de-ef41-41e9-8d49-05358c2f615a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:27.622058 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-198c99de-ef41-41e9-8d49-05358c2f615a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:27.782987 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-198c99de-ef41-41e9-8d49-05358c2f615a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:27.791655 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-198c99de-ef41-41e9-8d49-05358c2f615a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1527 microversion: 2.1 time: 0.189978 Oct 28 09:51:27.792243 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 173/353] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:27 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1527 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:51:27.895140 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-f8f05da2-598f-499e-98f9-58a311cd6069 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:27.895837 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-f8f05da2-598f-499e-98f9-58a311cd6069 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:27.902700 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f8f05da2-598f-499e-98f9-58a311cd6069 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:27.903148 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f8f05da2-598f-499e-98f9-58a311cd6069 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:27.903926 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f8f05da2-598f-499e-98f9-58a311cd6069 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:27.904356 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f8f05da2-598f-499e-98f9-58a311cd6069 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:28.057267 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-f8f05da2-598f-499e-98f9-58a311cd6069 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:28.065122 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-f8f05da2-598f-499e-98f9-58a311cd6069 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1362 microversion: 2.1 time: 0.173728 Oct 28 09:51:28.073283 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 181/354] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:27 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:51:28.117068 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-ec4a28cd-f648-4c15-882b-90aa14a730b7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:28.117813 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-ec4a28cd-f648-4c15-882b-90aa14a730b7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:28.127078 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ec4a28cd-f648-4c15-882b-90aa14a730b7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:28.127633 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ec4a28cd-f648-4c15-882b-90aa14a730b7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:28.128566 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ec4a28cd-f648-4c15-882b-90aa14a730b7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:28.129230 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ec4a28cd-f648-4c15-882b-90aa14a730b7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:28.291825 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-ec4a28cd-f648-4c15-882b-90aa14a730b7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:28.300444 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-ec4a28cd-f648-4c15-882b-90aa14a730b7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:28.302146 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-ec4a28cd-f648-4c15-882b-90aa14a730b7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:28.303362 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-ec4a28cd-f648-4c15-882b-90aa14a730b7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1725 microversion: 2.20 time: 0.190105 Oct 28 09:51:28.304122 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 174/355] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:51:28 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1725 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:28.629214 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-571a31a2-1538-45c2-b129-1f61be4957ad tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:28.629848 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-571a31a2-1538-45c2-b129-1f61be4957ad tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:28.636925 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-571a31a2-1538-45c2-b129-1f61be4957ad tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:28.637439 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-571a31a2-1538-45c2-b129-1f61be4957ad tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:28.638213 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-571a31a2-1538-45c2-b129-1f61be4957ad tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:28.639123 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-571a31a2-1538-45c2-b129-1f61be4957ad tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:28.704623 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-571a31a2-1538-45c2-b129-1f61be4957ad tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:28.712229 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-571a31a2-1538-45c2-b129-1f61be4957ad tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1141 microversion: 2.1 time: 0.087009 Oct 28 09:51:28.713095 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 182/356] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:28 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1141 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:28.811095 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-b6c3f5e0-794a-40d6-8592-4035df644a87 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:28.811699 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-b6c3f5e0-794a-40d6-8592-4035df644a87 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:28.817639 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b6c3f5e0-794a-40d6-8592-4035df644a87 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:28.818101 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b6c3f5e0-794a-40d6-8592-4035df644a87 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:28.818917 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b6c3f5e0-794a-40d6-8592-4035df644a87 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:28.819337 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b6c3f5e0-794a-40d6-8592-4035df644a87 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:28.965271 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-b6c3f5e0-794a-40d6-8592-4035df644a87 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:28.972842 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-b6c3f5e0-794a-40d6-8592-4035df644a87 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1527 microversion: 2.1 time: 0.165465 Oct 28 09:51:28.975652 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 175/357] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:28 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1527 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:29.082627 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-e8ff5c13-6123-4073-b4df-6a95270f2973 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:29.083245 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-e8ff5c13-6123-4073-b4df-6a95270f2973 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:29.090353 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e8ff5c13-6123-4073-b4df-6a95270f2973 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:29.090881 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e8ff5c13-6123-4073-b4df-6a95270f2973 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:29.091781 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e8ff5c13-6123-4073-b4df-6a95270f2973 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:29.092332 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e8ff5c13-6123-4073-b4df-6a95270f2973 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:29.302311 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-e8ff5c13-6123-4073-b4df-6a95270f2973 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:29.322823 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-aa3aeb88-1db0-460e-be49-b0f391783a42 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:29.323455 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-aa3aeb88-1db0-460e-be49-b0f391783a42 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:29.325110 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-e8ff5c13-6123-4073-b4df-6a95270f2973 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1362 microversion: 2.1 time: 0.246014 Oct 28 09:51:29.326827 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 183/358] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:29 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:29.339003 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-aa3aeb88-1db0-460e-be49-b0f391783a42 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:29.339499 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-aa3aeb88-1db0-460e-be49-b0f391783a42 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:29.340394 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-aa3aeb88-1db0-460e-be49-b0f391783a42 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:29.340936 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-aa3aeb88-1db0-460e-be49-b0f391783a42 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:29.531629 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-aa3aeb88-1db0-460e-be49-b0f391783a42 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:29.540040 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-aa3aeb88-1db0-460e-be49-b0f391783a42 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:29.545101 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-aa3aeb88-1db0-460e-be49-b0f391783a42 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:29.548142 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-aa3aeb88-1db0-460e-be49-b0f391783a42 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1725 microversion: 2.20 time: 0.230512 Oct 28 09:51:29.553797 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 176/359] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:51:29 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1725 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:29.734742 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-f333b4b7-aeca-4331-b86a-becd599b493b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:29.735713 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-f333b4b7-aeca-4331-b86a-becd599b493b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:29.742244 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f333b4b7-aeca-4331-b86a-becd599b493b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:29.747914 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f333b4b7-aeca-4331-b86a-becd599b493b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:29.747914 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f333b4b7-aeca-4331-b86a-becd599b493b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:29.747914 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f333b4b7-aeca-4331-b86a-becd599b493b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:29.837868 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-f333b4b7-aeca-4331-b86a-becd599b493b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:29.846378 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-f333b4b7-aeca-4331-b86a-becd599b493b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1141 microversion: 2.1 time: 0.120747 Oct 28 09:51:29.847058 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 184/360] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:29 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1141 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:29.990747 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-75ec3130-8fc7-4bc5-bd04-dbcfdfebfdbd tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:29.991524 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-75ec3130-8fc7-4bc5-bd04-dbcfdfebfdbd tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:29.998732 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-75ec3130-8fc7-4bc5-bd04-dbcfdfebfdbd tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:30.011918 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-75ec3130-8fc7-4bc5-bd04-dbcfdfebfdbd tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:30.011918 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-75ec3130-8fc7-4bc5-bd04-dbcfdfebfdbd tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:30.011918 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-75ec3130-8fc7-4bc5-bd04-dbcfdfebfdbd tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:30.143293 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-75ec3130-8fc7-4bc5-bd04-dbcfdfebfdbd tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:30.151574 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-75ec3130-8fc7-4bc5-bd04-dbcfdfebfdbd tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1527 microversion: 2.1 time: 0.164607 Oct 28 09:51:30.152177 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 177/361] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:29 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1527 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:30.344015 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-810424e0-c4e5-4903-aa0e-83d759542250 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:30.345238 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-810424e0-c4e5-4903-aa0e-83d759542250 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:30.352048 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-810424e0-c4e5-4903-aa0e-83d759542250 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:30.352497 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-810424e0-c4e5-4903-aa0e-83d759542250 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:30.353862 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-810424e0-c4e5-4903-aa0e-83d759542250 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:30.354010 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-810424e0-c4e5-4903-aa0e-83d759542250 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:30.511361 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-810424e0-c4e5-4903-aa0e-83d759542250 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:30.520177 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-810424e0-c4e5-4903-aa0e-83d759542250 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1362 microversion: 2.1 time: 0.180590 Oct 28 09:51:30.520797 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 185/362] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:30 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:30.566907 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-45b26864-f8eb-4323-9e56-398538e19249 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:30.567635 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-45b26864-f8eb-4323-9e56-398538e19249 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:30.574257 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-45b26864-f8eb-4323-9e56-398538e19249 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:30.574708 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-45b26864-f8eb-4323-9e56-398538e19249 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:30.575490 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-45b26864-f8eb-4323-9e56-398538e19249 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:30.575922 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-45b26864-f8eb-4323-9e56-398538e19249 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:30.714045 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-45b26864-f8eb-4323-9e56-398538e19249 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:30.722344 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-45b26864-f8eb-4323-9e56-398538e19249 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:30.723780 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-45b26864-f8eb-4323-9e56-398538e19249 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:30.725179 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-45b26864-f8eb-4323-9e56-398538e19249 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1725 microversion: 2.20 time: 0.162051 Oct 28 09:51:30.728690 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 178/363] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:51:30 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:30.864526 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-7d443691-9003-4920-99df-374b59b72ef5 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:30.865306 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-7d443691-9003-4920-99df-374b59b72ef5 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:30.872349 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7d443691-9003-4920-99df-374b59b72ef5 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:30.872816 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7d443691-9003-4920-99df-374b59b72ef5 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:30.873592 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7d443691-9003-4920-99df-374b59b72ef5 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:30.874011 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7d443691-9003-4920-99df-374b59b72ef5 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:30.982373 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-7d443691-9003-4920-99df-374b59b72ef5 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:30.990353 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-7d443691-9003-4920-99df-374b59b72ef5 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1141 microversion: 2.1 time: 0.129352 Oct 28 09:51:30.999391 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 186/364] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:30 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1141 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:31.172634 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-65ed77bc-677c-4d2e-b6c8-9aee2aac576b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:31.173388 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-65ed77bc-677c-4d2e-b6c8-9aee2aac576b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:31.180333 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-65ed77bc-677c-4d2e-b6c8-9aee2aac576b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:31.180960 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-65ed77bc-677c-4d2e-b6c8-9aee2aac576b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:31.181872 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-65ed77bc-677c-4d2e-b6c8-9aee2aac576b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:31.182311 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-65ed77bc-677c-4d2e-b6c8-9aee2aac576b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:31.355317 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-65ed77bc-677c-4d2e-b6c8-9aee2aac576b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:31.363198 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-65ed77bc-677c-4d2e-b6c8-9aee2aac576b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1527 microversion: 2.1 time: 0.194164 Oct 28 09:51:31.363768 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 179/365] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:31 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1527 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:51:31.536872 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-19e14cd1-a9c1-4cdf-8a38-c9d1acca5932 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:31.538439 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-19e14cd1-a9c1-4cdf-8a38-c9d1acca5932 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:31.543320 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-19e14cd1-a9c1-4cdf-8a38-c9d1acca5932 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:31.543997 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-19e14cd1-a9c1-4cdf-8a38-c9d1acca5932 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:31.544973 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-19e14cd1-a9c1-4cdf-8a38-c9d1acca5932 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:31.545550 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-19e14cd1-a9c1-4cdf-8a38-c9d1acca5932 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:31.692603 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-19e14cd1-a9c1-4cdf-8a38-c9d1acca5932 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:31.702654 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-19e14cd1-a9c1-4cdf-8a38-c9d1acca5932 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1362 microversion: 2.1 time: 0.169638 Oct 28 09:51:31.703797 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 187/366] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:31 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:31.745317 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-359e5061-c64f-44e3-901a-e698d4b466f2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:31.746385 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-359e5061-c64f-44e3-901a-e698d4b466f2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:31.752927 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-359e5061-c64f-44e3-901a-e698d4b466f2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:31.753372 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-359e5061-c64f-44e3-901a-e698d4b466f2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:31.754221 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-359e5061-c64f-44e3-901a-e698d4b466f2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:31.754581 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-359e5061-c64f-44e3-901a-e698d4b466f2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:31.895621 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-359e5061-c64f-44e3-901a-e698d4b466f2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:31.903967 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-359e5061-c64f-44e3-901a-e698d4b466f2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:31.905759 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-359e5061-c64f-44e3-901a-e698d4b466f2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:31.906920 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-359e5061-c64f-44e3-901a-e698d4b466f2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1725 microversion: 2.20 time: 0.167366 Oct 28 09:51:31.907484 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 180/367] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:51:31 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:32.011949 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-dee47d71-2bd5-4a00-9e65-59b108fbdb1e tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:32.013416 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-dee47d71-2bd5-4a00-9e65-59b108fbdb1e tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:32.021025 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-dee47d71-2bd5-4a00-9e65-59b108fbdb1e tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:32.021733 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-dee47d71-2bd5-4a00-9e65-59b108fbdb1e tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:32.022653 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-dee47d71-2bd5-4a00-9e65-59b108fbdb1e tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:32.023173 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-dee47d71-2bd5-4a00-9e65-59b108fbdb1e tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:32.121330 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-dee47d71-2bd5-4a00-9e65-59b108fbdb1e tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:32.137425 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-dee47d71-2bd5-4a00-9e65-59b108fbdb1e tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1141 microversion: 2.1 time: 0.131330 Oct 28 09:51:32.147510 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 188/368] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:32 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1141 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:32.381452 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-6672c51a-9ea3-4a77-90c1-a854d4b0d914 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:32.383256 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-6672c51a-9ea3-4a77-90c1-a854d4b0d914 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:32.390175 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6672c51a-9ea3-4a77-90c1-a854d4b0d914 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:32.390762 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6672c51a-9ea3-4a77-90c1-a854d4b0d914 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:32.392063 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6672c51a-9ea3-4a77-90c1-a854d4b0d914 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:32.392567 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6672c51a-9ea3-4a77-90c1-a854d4b0d914 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:32.528441 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-6672c51a-9ea3-4a77-90c1-a854d4b0d914 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:32.536054 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-6672c51a-9ea3-4a77-90c1-a854d4b0d914 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1527 microversion: 2.1 time: 0.158524 Oct 28 09:51:32.543635 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 181/369] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:32 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1527 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:32.719678 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-c02a8828-c1b9-453f-9dcf-a15bf40c2474 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:32.720323 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-c02a8828-c1b9-453f-9dcf-a15bf40c2474 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:32.726414 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c02a8828-c1b9-453f-9dcf-a15bf40c2474 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:32.727321 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c02a8828-c1b9-453f-9dcf-a15bf40c2474 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:32.728323 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c02a8828-c1b9-453f-9dcf-a15bf40c2474 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:32.729007 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c02a8828-c1b9-453f-9dcf-a15bf40c2474 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:32.905761 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-c02a8828-c1b9-453f-9dcf-a15bf40c2474 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:32.913943 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-c02a8828-c1b9-453f-9dcf-a15bf40c2474 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1362 microversion: 2.1 time: 0.197963 Oct 28 09:51:32.914510 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 189/370] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:32 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1362 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:32.926210 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-a7023ac6-58dd-446a-90d8-4feee9fffb09 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:32.930933 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-a7023ac6-58dd-446a-90d8-4feee9fffb09 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:32.934397 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a7023ac6-58dd-446a-90d8-4feee9fffb09 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:32.934847 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a7023ac6-58dd-446a-90d8-4feee9fffb09 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:32.935637 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a7023ac6-58dd-446a-90d8-4feee9fffb09 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:32.936066 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a7023ac6-58dd-446a-90d8-4feee9fffb09 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:33.027038 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [req-3f15a824-c6d1-4e35-96b9-7ac3504fb1ae req-1c1d862a-a61c-4160-adac-988b3ffc7170 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d623582-8352-4294-9aca-086539f32232", "tag": "cbe862a5-40a7-43ef-b2b3-73aad1487228"}]} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:33.031701 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:51:33.031701 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 09:51:33.047585 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-3f15a824-c6d1-4e35-96b9-7ac3504fb1ae req-1c1d862a-a61c-4160-adac-988b3ffc7170 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:33.050120 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-3f15a824-c6d1-4e35-96b9-7ac3504fb1ae req-1c1d862a-a61c-4160-adac-988b3ffc7170 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:33.067290 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.compute.server_external_events [req-3f15a824-c6d1-4e35-96b9-7ac3504fb1ae req-1c1d862a-a61c-4160-adac-988b3ffc7170 service nova] Creating event network-changed:cbe862a5-40a7-43ef-b2b3-73aad1487228 for instance 2d623582-8352-4294-9aca-086539f32232 on hv-cinder-81571 Oct 28 09:51:33.090038 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [req-3f15a824-c6d1-4e35-96b9-7ac3504fb1ae req-1c1d862a-a61c-4160-adac-988b3ffc7170 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066988 Oct 28 09:51:33.094093 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 190/371] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:51:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:51:33.099605 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-a7023ac6-58dd-446a-90d8-4feee9fffb09 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:33.108741 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-a7023ac6-58dd-446a-90d8-4feee9fffb09 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:33.110452 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-a7023ac6-58dd-446a-90d8-4feee9fffb09 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:33.111876 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-a7023ac6-58dd-446a-90d8-4feee9fffb09 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1725 microversion: 2.20 time: 0.189478 Oct 28 09:51:33.112680 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 182/372] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:51:32 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1725 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:33.155710 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-84e5826d-b64c-4afa-9a37-f6be27664629 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:33.156474 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-84e5826d-b64c-4afa-9a37-f6be27664629 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:33.163416 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-84e5826d-b64c-4afa-9a37-f6be27664629 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:33.163865 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-84e5826d-b64c-4afa-9a37-f6be27664629 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:33.164814 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-84e5826d-b64c-4afa-9a37-f6be27664629 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:33.165287 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-84e5826d-b64c-4afa-9a37-f6be27664629 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:33.231331 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-84e5826d-b64c-4afa-9a37-f6be27664629 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:33.239137 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-84e5826d-b64c-4afa-9a37-f6be27664629 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1133 microversion: 2.1 time: 0.087982 Oct 28 09:51:33.239703 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 191/373] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:33 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1133 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:33.553687 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-07a925a6-7443-4f70-baed-d9442ec74d77 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:33.554299 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-07a925a6-7443-4f70-baed-d9442ec74d77 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:33.561762 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-07a925a6-7443-4f70-baed-d9442ec74d77 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:33.562213 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-07a925a6-7443-4f70-baed-d9442ec74d77 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:33.563061 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-07a925a6-7443-4f70-baed-d9442ec74d77 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:33.563458 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-07a925a6-7443-4f70-baed-d9442ec74d77 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:33.688588 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-07a925a6-7443-4f70-baed-d9442ec74d77 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:33.696007 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-07a925a6-7443-4f70-baed-d9442ec74d77 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1527 microversion: 2.1 time: 0.145972 Oct 28 09:51:33.696590 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 183/374] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:33 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1527 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:33.931727 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-44b65a10-2812-40d0-9a6b-c12463b31a09 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:33.932382 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-44b65a10-2812-40d0-9a6b-c12463b31a09 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:33.938521 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-44b65a10-2812-40d0-9a6b-c12463b31a09 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:33.938956 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-44b65a10-2812-40d0-9a6b-c12463b31a09 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:33.939730 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-44b65a10-2812-40d0-9a6b-c12463b31a09 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:33.940161 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-44b65a10-2812-40d0-9a6b-c12463b31a09 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:34.067136 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-44b65a10-2812-40d0-9a6b-c12463b31a09 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:34.074953 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-44b65a10-2812-40d0-9a6b-c12463b31a09 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1362 microversion: 2.1 time: 0.147008 Oct 28 09:51:34.075538 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 192/375] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:33 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:34.130981 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-45b0687f-779b-4b4b-8e97-c34b01db7093 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:34.131599 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-45b0687f-779b-4b4b-8e97-c34b01db7093 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:34.138175 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-45b0687f-779b-4b4b-8e97-c34b01db7093 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:34.138625 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-45b0687f-779b-4b4b-8e97-c34b01db7093 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:34.141718 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-45b0687f-779b-4b4b-8e97-c34b01db7093 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:34.141718 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-45b0687f-779b-4b4b-8e97-c34b01db7093 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:34.256714 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-eacc9a0f-9109-4f4a-b78f-fb8675a32b4e tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:34.257243 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-eacc9a0f-9109-4f4a-b78f-fb8675a32b4e tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:34.262207 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-45b0687f-779b-4b4b-8e97-c34b01db7093 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:34.264132 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-eacc9a0f-9109-4f4a-b78f-fb8675a32b4e tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:34.264574 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-eacc9a0f-9109-4f4a-b78f-fb8675a32b4e tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:34.265378 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-eacc9a0f-9109-4f4a-b78f-fb8675a32b4e tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:34.265805 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-eacc9a0f-9109-4f4a-b78f-fb8675a32b4e tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:34.270063 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-45b0687f-779b-4b4b-8e97-c34b01db7093 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:34.271576 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-45b0687f-779b-4b4b-8e97-c34b01db7093 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:34.272759 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-45b0687f-779b-4b4b-8e97-c34b01db7093 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1725 microversion: 2.20 time: 0.145533 Oct 28 09:51:34.273297 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 184/376] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:51:34 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:34.331175 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-eacc9a0f-9109-4f4a-b78f-fb8675a32b4e tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:34.339345 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-eacc9a0f-9109-4f4a-b78f-fb8675a32b4e tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1133 microversion: 2.1 time: 0.086315 Oct 28 09:51:34.339939 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 193/377] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:34 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1133 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:51:34.713096 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-4ee76467-408f-4d2d-b6b5-68befe09b3f7 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:34.713710 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-4ee76467-408f-4d2d-b6b5-68befe09b3f7 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:34.720011 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4ee76467-408f-4d2d-b6b5-68befe09b3f7 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:34.720457 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4ee76467-408f-4d2d-b6b5-68befe09b3f7 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:34.721260 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4ee76467-408f-4d2d-b6b5-68befe09b3f7 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:34.721697 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4ee76467-408f-4d2d-b6b5-68befe09b3f7 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:34.849059 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-4ee76467-408f-4d2d-b6b5-68befe09b3f7 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:34.856526 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-4ee76467-408f-4d2d-b6b5-68befe09b3f7 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1527 microversion: 2.1 time: 0.147103 Oct 28 09:51:34.857132 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 185/378] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:34 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1527 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:35.093873 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-1812103f-4956-40ef-96e0-2833781b2bc3 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:35.094423 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-1812103f-4956-40ef-96e0-2833781b2bc3 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:35.101056 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1812103f-4956-40ef-96e0-2833781b2bc3 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:35.101719 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1812103f-4956-40ef-96e0-2833781b2bc3 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:35.102963 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1812103f-4956-40ef-96e0-2833781b2bc3 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:35.103234 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1812103f-4956-40ef-96e0-2833781b2bc3 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:35.291888 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-afda8bec-0e29-4785-b483-a77f1a4bda0e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:35.292620 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-afda8bec-0e29-4785-b483-a77f1a4bda0e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:35.293641 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-1812103f-4956-40ef-96e0-2833781b2bc3 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:35.300026 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-afda8bec-0e29-4785-b483-a77f1a4bda0e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:35.300954 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-afda8bec-0e29-4785-b483-a77f1a4bda0e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:35.301472 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-afda8bec-0e29-4785-b483-a77f1a4bda0e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:35.301807 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-1812103f-4956-40ef-96e0-2833781b2bc3 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1362 microversion: 2.1 time: 0.212161 Oct 28 09:51:35.302029 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-afda8bec-0e29-4785-b483-a77f1a4bda0e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:35.303101 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 194/379] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:35 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:35.355639 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-0274a80e-8361-4c15-bdb6-b8b5014902f2 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:35.356258 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-0274a80e-8361-4c15-bdb6-b8b5014902f2 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:35.362287 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0274a80e-8361-4c15-bdb6-b8b5014902f2 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:35.362973 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0274a80e-8361-4c15-bdb6-b8b5014902f2 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:35.363941 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0274a80e-8361-4c15-bdb6-b8b5014902f2 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:35.364532 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0274a80e-8361-4c15-bdb6-b8b5014902f2 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:35.454042 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-0274a80e-8361-4c15-bdb6-b8b5014902f2 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:35.461863 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-0274a80e-8361-4c15-bdb6-b8b5014902f2 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1189 microversion: 2.1 time: 0.110022 Oct 28 09:51:35.471830 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 195/380] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:35 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1189 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:35.538152 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-afda8bec-0e29-4785-b483-a77f1a4bda0e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:35.546495 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-afda8bec-0e29-4785-b483-a77f1a4bda0e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:35.548008 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-afda8bec-0e29-4785-b483-a77f1a4bda0e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:35.549615 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-afda8bec-0e29-4785-b483-a77f1a4bda0e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1725 microversion: 2.20 time: 0.261447 Oct 28 09:51:35.549870 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 186/381] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:51:35 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1725 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:51:35.875214 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-89168441-905e-4516-9f99-ed186f983b9b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:35.875822 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-89168441-905e-4516-9f99-ed186f983b9b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:35.881874 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-89168441-905e-4516-9f99-ed186f983b9b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:35.882316 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-89168441-905e-4516-9f99-ed186f983b9b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:35.883537 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-89168441-905e-4516-9f99-ed186f983b9b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:35.884039 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-89168441-905e-4516-9f99-ed186f983b9b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:35.991074 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-2f2eff3f-259c-4cdc-bd87-d8c6c175e43c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1697914718", "imageRef": "623b30fc-1d92-46d9-b556-b9b963f3d76c", "flavorRef": "452", "networks": [{"uuid": "6e0d2282-0092-43e0-98c8-b68cec136250"}]}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:36.063729 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.network.neutron [None req-2f2eff3f-259c-4cdc-bd87-d8c6c175e43c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] validate_networks() for [('6e0d2282-0092-43e0-98c8-b68cec136250', None, None, None, None, None)] {{(pid=123068) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 09:51:36.331068 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-89168441-905e-4516-9f99-ed186f983b9b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:36.339338 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-89168441-905e-4516-9f99-ed186f983b9b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1527 microversion: 2.1 time: 0.468027 Oct 28 09:51:36.342555 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 196/382] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:35 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1527 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:51:36.344531 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-bbf34507-39d1-4a93-8483-fac5658a9cab tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:36.345184 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-bbf34507-39d1-4a93-8483-fac5658a9cab tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:36.353940 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bbf34507-39d1-4a93-8483-fac5658a9cab tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:36.354374 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bbf34507-39d1-4a93-8483-fac5658a9cab tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:36.355419 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bbf34507-39d1-4a93-8483-fac5658a9cab tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:36.355952 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bbf34507-39d1-4a93-8483-fac5658a9cab tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:36.638430 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-bbf34507-39d1-4a93-8483-fac5658a9cab tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:36.648959 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-bbf34507-39d1-4a93-8483-fac5658a9cab tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1362 microversion: 2.1 time: 0.307882 Oct 28 09:51:36.649534 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 197/383] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:36 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1362 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:36.655396 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-570b6640-9ef7-4d5e-9fff-eb2e80a173d5 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:36.655949 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-570b6640-9ef7-4d5e-9fff-eb2e80a173d5 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:36.663860 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-570b6640-9ef7-4d5e-9fff-eb2e80a173d5 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:36.664465 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-570b6640-9ef7-4d5e-9fff-eb2e80a173d5 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:36.665835 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-570b6640-9ef7-4d5e-9fff-eb2e80a173d5 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:36.666521 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-570b6640-9ef7-4d5e-9fff-eb2e80a173d5 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:36.689953 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-2f2eff3f-259c-4cdc-bd87-d8c6c175e43c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Flavor limits 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:51:36.690416 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-2f2eff3f-259c-4cdc-bd87-d8c6c175e43c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Image limits 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:51:36.690891 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-2f2eff3f-259c-4cdc-bd87-d8c6c175e43c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Flavor pref 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:51:36.691303 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-2f2eff3f-259c-4cdc-bd87-d8c6c175e43c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Image pref 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:51:36.691860 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-2f2eff3f-259c-4cdc-bd87-d8c6c175e43c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:51:36.708181 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2f2eff3f-259c-4cdc-bd87-d8c6c175e43c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:36.710339 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2f2eff3f-259c-4cdc-bd87-d8c6c175e43c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:36.710339 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2f2eff3f-259c-4cdc-bd87-d8c6c175e43c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:36.710339 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2f2eff3f-259c-4cdc-bd87-d8c6c175e43c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:36.734144 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.quota [None req-2f2eff3f-259c-4cdc-bd87-d8c6c175e43c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Getting quotas for project d487a772480347a0b31aebb5f8cf6b7a. Resources: {'ram', 'cores', 'instances'} {{(pid=123068) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 09:51:36.740429 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.quota [None req-2f2eff3f-259c-4cdc-bd87-d8c6c175e43c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Getting quotas for user 8e13e30490a54220ad0df4feee2ffcb2 and project d487a772480347a0b31aebb5f8cf6b7a. Resources: {'ram', 'cores', 'instances'} {{(pid=123068) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 09:51:36.741796 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-570b6640-9ef7-4d5e-9fff-eb2e80a173d5 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:36.752919 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-570b6640-9ef7-4d5e-9fff-eb2e80a173d5 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1197 microversion: 2.1 time: 0.101506 Oct 28 09:51:36.763888 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-2f2eff3f-259c-4cdc-bd87-d8c6c175e43c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Going to run 1 instances... {{(pid=123068) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 09:51:36.763888 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-2f2eff3f-259c-4cdc-bd87-d8c6c175e43c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: 68f4383c-7f8e-4f49-9377-f11540e9f81e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='623b30fc-1d92-46d9-b556-b9b963f3d76c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 09:51:36.764289 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 198/384] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:36 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:36.764289 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-6f2c4c8f-ce63-4211-9a8d-ab2025f1d9c4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:36.764289 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-6f2c4c8f-ce63-4211-9a8d-ab2025f1d9c4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:36.778577 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6f2c4c8f-ce63-4211-9a8d-ab2025f1d9c4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:36.779282 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6f2c4c8f-ce63-4211-9a8d-ab2025f1d9c4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:36.780065 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6f2c4c8f-ce63-4211-9a8d-ab2025f1d9c4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:36.780489 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6f2c4c8f-ce63-4211-9a8d-ab2025f1d9c4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:36.917856 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-2f2eff3f-259c-4cdc-bd87-d8c6c175e43c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.930757 Oct 28 09:51:36.923510 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-6f2c4c8f-ce63-4211-9a8d-ab2025f1d9c4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:36.924146 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 187/385] 10.222.0.104 () {60 vars in 1151 bytes} [Thu Oct 28 09:51:35 2021] POST /compute/v2.1/servers => generated 382 bytes in 938 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 28 09:51:36.929676 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-dbb897c6-f03e-43fd-99c4-d302dabdcb54 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:36.929818 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-6f2c4c8f-ce63-4211-9a8d-ab2025f1d9c4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:36.930674 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-dbb897c6-f03e-43fd-99c4-d302dabdcb54 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: 68f4383c-7f8e-4f49-9377-f11540e9f81e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:36.932059 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-6f2c4c8f-ce63-4211-9a8d-ab2025f1d9c4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:36.933375 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-6f2c4c8f-ce63-4211-9a8d-ab2025f1d9c4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1728 microversion: 2.20 time: 0.175319 Oct 28 09:51:36.933945 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 199/386] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:51:36 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:36.953410 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-5cc3da17-6ef4-4d61-a3b0-8bf36725e8d3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5e03358-aef2-4e06-a636-f0967ef104da"}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:36.954938 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-5cc3da17-6ef4-4d61-a3b0-8bf36725e8d3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:36.968691 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5cc3da17-6ef4-4d61-a3b0-8bf36725e8d3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:36.973362 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5cc3da17-6ef4-4d61-a3b0-8bf36725e8d3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:36.974455 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5cc3da17-6ef4-4d61-a3b0-8bf36725e8d3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:36.975241 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5cc3da17-6ef4-4d61-a3b0-8bf36725e8d3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:36.990564 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-dbb897c6-f03e-43fd-99c4-d302dabdcb54 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:37.001682 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-dbb897c6-f03e-43fd-99c4-d302dabdcb54 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e" status: 200 len: 1218 microversion: 2.1 time: 0.076207 Oct 28 09:51:37.007139 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 188/387] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:36 2021] GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e => generated 1218 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:37.356953 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-3a6aae02-6c02-48fa-b6ca-525efe10e2fd tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:37.357670 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-3a6aae02-6c02-48fa-b6ca-525efe10e2fd tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:37.364176 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3a6aae02-6c02-48fa-b6ca-525efe10e2fd tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:37.364620 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3a6aae02-6c02-48fa-b6ca-525efe10e2fd tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:37.365488 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3a6aae02-6c02-48fa-b6ca-525efe10e2fd tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:37.365924 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3a6aae02-6c02-48fa-b6ca-525efe10e2fd tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:37.501733 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-3a6aae02-6c02-48fa-b6ca-525efe10e2fd tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:37.517996 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-3a6aae02-6c02-48fa-b6ca-525efe10e2fd tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1527 microversion: 2.1 time: 0.164973 Oct 28 09:51:37.519200 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 189/388] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:37 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1527 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:51:37.668321 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-fe2e31bd-4ff3-4e13-b54c-fbabc14ed2de tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:37.668983 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-fe2e31bd-4ff3-4e13-b54c-fbabc14ed2de tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:37.684054 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fe2e31bd-4ff3-4e13-b54c-fbabc14ed2de tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:37.684054 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fe2e31bd-4ff3-4e13-b54c-fbabc14ed2de tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:37.684054 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fe2e31bd-4ff3-4e13-b54c-fbabc14ed2de tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:37.689063 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fe2e31bd-4ff3-4e13-b54c-fbabc14ed2de tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:37.855789 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-fe2e31bd-4ff3-4e13-b54c-fbabc14ed2de tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:37.864445 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-fe2e31bd-4ff3-4e13-b54c-fbabc14ed2de tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1362 microversion: 2.1 time: 0.200773 Oct 28 09:51:37.865318 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 190/389] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:37 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:51:37.870562 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-aa20ff10-01bf-4676-8f62-e34c0d352f1b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:37.872814 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-aa20ff10-01bf-4676-8f62-e34c0d352f1b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:37.877539 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-aa20ff10-01bf-4676-8f62-e34c0d352f1b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:37.878287 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-aa20ff10-01bf-4676-8f62-e34c0d352f1b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:37.879282 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-aa20ff10-01bf-4676-8f62-e34c0d352f1b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:37.879789 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-aa20ff10-01bf-4676-8f62-e34c0d352f1b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:38.033901 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-aa20ff10-01bf-4676-8f62-e34c0d352f1b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:38.041806 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-aa20ff10-01bf-4676-8f62-e34c0d352f1b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1275 microversion: 2.1 time: 0.175100 Oct 28 09:51:38.042400 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 191/390] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:37 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1275 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:38.047874 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-9ae4e98f-461b-48ba-a4f6-59542677211c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:38.048488 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-9ae4e98f-461b-48ba-a4f6-59542677211c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: 68f4383c-7f8e-4f49-9377-f11540e9f81e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:38.120412 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-9ae4e98f-461b-48ba-a4f6-59542677211c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:38.127447 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-9ae4e98f-461b-48ba-a4f6-59542677211c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e" status: 200 len: 1218 microversion: 2.1 time: 0.084097 Oct 28 09:51:38.128822 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 192/391] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:38 2021] GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:38.487592 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-5cc3da17-6ef4-4d61-a3b0-8bf36725e8d3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.538027 Oct 28 09:51:38.488588 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 200/392] 10.222.0.104 () {62 vars in 1368 bytes} [Thu Oct 28 09:51:36 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/os-volume_attachments => generated 188 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:51:38.537141 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-49451248-1dfd-4f93-b18c-0acb229910b9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:38.537837 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-49451248-1dfd-4f93-b18c-0acb229910b9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:38.549025 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-49451248-1dfd-4f93-b18c-0acb229910b9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:38.549885 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-49451248-1dfd-4f93-b18c-0acb229910b9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:38.551687 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-49451248-1dfd-4f93-b18c-0acb229910b9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:38.552465 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-49451248-1dfd-4f93-b18c-0acb229910b9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:38.632030 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-2d9c1193-0ced-4949-b37a-7be128574e18 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:38.632599 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-2d9c1193-0ced-4949-b37a-7be128574e18 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:38.639965 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2d9c1193-0ced-4949-b37a-7be128574e18 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:38.640403 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2d9c1193-0ced-4949-b37a-7be128574e18 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:38.641242 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2d9c1193-0ced-4949-b37a-7be128574e18 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:38.641668 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2d9c1193-0ced-4949-b37a-7be128574e18 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:38.708636 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-49451248-1dfd-4f93-b18c-0acb229910b9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:38.725261 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-49451248-1dfd-4f93-b18c-0acb229910b9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1507 microversion: 2.1 time: 0.192187 Oct 28 09:51:38.726125 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 193/393] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:38 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1507 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:38.735482 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-70100775-67d1-4251-8b6f-94eeaa18dd98 req-a2390254-9db3-4f76-bb6d-e8522c899dce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a28831e5-4c0c-4dd9-bf92-ccf43a500b27", "tag": "94cbd2b9-09d8-4c85-ab69-0e95ad1404ee"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:38.737624 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:51:38.737624 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:51:38.746587 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-70100775-67d1-4251-8b6f-94eeaa18dd98 req-a2390254-9db3-4f76-bb6d-e8522c899dce service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:38.747017 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-70100775-67d1-4251-8b6f-94eeaa18dd98 req-a2390254-9db3-4f76-bb6d-e8522c899dce service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:38.759917 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-70100775-67d1-4251-8b6f-94eeaa18dd98 req-a2390254-9db3-4f76-bb6d-e8522c899dce service nova] Creating event network-changed:94cbd2b9-09d8-4c85-ab69-0e95ad1404ee for instance a28831e5-4c0c-4dd9-bf92-ccf43a500b27 on hv-cinder-81571 Oct 28 09:51:38.766002 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-70100775-67d1-4251-8b6f-94eeaa18dd98 req-a2390254-9db3-4f76-bb6d-e8522c899dce service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038409 Oct 28 09:51:38.767203 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 194/394] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:51:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:38.773930 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-b94a3022-fcaf-405c-bbd7-e0a0d5a20ed1 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1ba5fcf-77be-4296-92e3-a9d6d345784f"}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:38.775910 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-b94a3022-fcaf-405c-bbd7-e0a0d5a20ed1 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:38.782667 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b94a3022-fcaf-405c-bbd7-e0a0d5a20ed1 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:38.783336 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b94a3022-fcaf-405c-bbd7-e0a0d5a20ed1 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:38.784270 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b94a3022-fcaf-405c-bbd7-e0a0d5a20ed1 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:38.784896 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b94a3022-fcaf-405c-bbd7-e0a0d5a20ed1 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:38.814210 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.wsgi [None req-b94a3022-fcaf-405c-bbd7-e0a0d5a20ed1 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] HTTP exception thrown: Cannot 'attach_volume' instance 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f while it is in vm_state rescued Oct 28 09:51:38.814805 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-b94a3022-fcaf-405c-bbd7-e0a0d5a20ed1 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Returning 409 to user: Cannot 'attach_volume' instance 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f while it is in vm_state rescued {{(pid=123068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:51:38.815636 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-b94a3022-fcaf-405c-bbd7-e0a0d5a20ed1 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "POST /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047065 Oct 28 09:51:38.816209 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 195/395] 10.222.0.104 () {60 vars in 1327 bytes} [Thu Oct 28 09:51:38 2021] POST /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 09:51:38.824528 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-c79f1a0c-d812-4696-8660-0bb7bb202ca8 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:38.825114 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-c79f1a0c-d812-4696-8660-0bb7bb202ca8 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:38.832870 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c79f1a0c-d812-4696-8660-0bb7bb202ca8 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:38.833711 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c79f1a0c-d812-4696-8660-0bb7bb202ca8 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:38.834755 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c79f1a0c-d812-4696-8660-0bb7bb202ca8 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:38.835351 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c79f1a0c-d812-4696-8660-0bb7bb202ca8 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:38.936363 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-2d9c1193-0ced-4949-b37a-7be128574e18 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action" status: 202 len: 0 microversion: 2.20 time: 0.309583 Oct 28 09:51:38.937313 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 201/396] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:51:38 2021] POST /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:51:38.945360 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-c9770961-a153-48ec-bda5-93573837f5d2 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:38.945966 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-c9770961-a153-48ec-bda5-93573837f5d2 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:38.953370 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c9770961-a153-48ec-bda5-93573837f5d2 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:38.955635 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c9770961-a153-48ec-bda5-93573837f5d2 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:38.956475 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c9770961-a153-48ec-bda5-93573837f5d2 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:38.957108 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c9770961-a153-48ec-bda5-93573837f5d2 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:39.103396 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-c9770961-a153-48ec-bda5-93573837f5d2 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:39.110767 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-c9770961-a153-48ec-bda5-93573837f5d2 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1362 microversion: 2.1 time: 0.169095 Oct 28 09:51:39.111532 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 202/397] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:38 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:39.116743 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-b678947a-d5f1-41cd-8946-efe6421f4ad0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:39.117341 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-b678947a-d5f1-41cd-8946-efe6421f4ad0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:39.123888 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b678947a-d5f1-41cd-8946-efe6421f4ad0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:39.128871 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b678947a-d5f1-41cd-8946-efe6421f4ad0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:39.128871 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b678947a-d5f1-41cd-8946-efe6421f4ad0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:39.128871 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b678947a-d5f1-41cd-8946-efe6421f4ad0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:39.260442 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-c79f1a0c-d812-4696-8660-0bb7bb202ca8 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "POST /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f/action" status: 202 len: 0 microversion: 2.1 time: 0.438185 Oct 28 09:51:39.262456 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 196/398] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:51:38 2021] POST /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f/action => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 09:51:39.271297 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-01ac5b99-9ecf-483b-b293-0ae12b466f07 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:39.272882 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-01ac5b99-9ecf-483b-b293-0ae12b466f07 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:39.280023 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-b678947a-d5f1-41cd-8946-efe6421f4ad0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:39.289111 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-01ac5b99-9ecf-483b-b293-0ae12b466f07 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:39.289870 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-b678947a-d5f1-41cd-8946-efe6421f4ad0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:39.290010 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-01ac5b99-9ecf-483b-b293-0ae12b466f07 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:39.291825 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-b678947a-d5f1-41cd-8946-efe6421f4ad0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:39.291990 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-01ac5b99-9ecf-483b-b293-0ae12b466f07 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:39.292442 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-01ac5b99-9ecf-483b-b293-0ae12b466f07 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:39.293546 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-b678947a-d5f1-41cd-8946-efe6421f4ad0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1754 microversion: 2.20 time: 0.180573 Oct 28 09:51:39.294526 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 203/399] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:51:39 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1754 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:39.299508 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-bae452b1-ff36-4d29-90c5-f7857889f3d8 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:39.300510 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-bae452b1-ff36-4d29-90c5-f7857889f3d8 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: 68f4383c-7f8e-4f49-9377-f11540e9f81e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:39.307399 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bae452b1-ff36-4d29-90c5-f7857889f3d8 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:39.308061 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bae452b1-ff36-4d29-90c5-f7857889f3d8 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:39.309062 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bae452b1-ff36-4d29-90c5-f7857889f3d8 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:39.309646 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bae452b1-ff36-4d29-90c5-f7857889f3d8 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:39.421528 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-bae452b1-ff36-4d29-90c5-f7857889f3d8 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:39.430082 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-bae452b1-ff36-4d29-90c5-f7857889f3d8 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e" status: 200 len: 1270 microversion: 2.1 time: 0.133898 Oct 28 09:51:39.430274 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 204/400] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:39 2021] GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e => generated 1270 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:39.456061 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-a944c46c-4089-46c1-9490-31cbb0f9e95b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:39.456685 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-a944c46c-4089-46c1-9490-31cbb0f9e95b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:39.467020 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a944c46c-4089-46c1-9490-31cbb0f9e95b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:39.467773 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a944c46c-4089-46c1-9490-31cbb0f9e95b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:39.468313 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a944c46c-4089-46c1-9490-31cbb0f9e95b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:39.468678 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a944c46c-4089-46c1-9490-31cbb0f9e95b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:39.524045 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-01ac5b99-9ecf-483b-b293-0ae12b466f07 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:39.533007 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-01ac5b99-9ecf-483b-b293-0ae12b466f07 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1263 microversion: 2.1 time: 0.268365 Oct 28 09:51:39.533892 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 197/401] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:39 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1263 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:39.689351 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-a944c46c-4089-46c1-9490-31cbb0f9e95b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:39.699144 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-a944c46c-4089-46c1-9490-31cbb0f9e95b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1515 microversion: 2.1 time: 0.247066 Oct 28 09:51:39.700024 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 205/402] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:39 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1515 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:39.795838 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-8a5f4771-e6a3-498b-8e67-069ebdcd08f7 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:39.796854 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-8a5f4771-e6a3-498b-8e67-069ebdcd08f7 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:39.804617 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8a5f4771-e6a3-498b-8e67-069ebdcd08f7 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:39.805431 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8a5f4771-e6a3-498b-8e67-069ebdcd08f7 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:39.807405 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8a5f4771-e6a3-498b-8e67-069ebdcd08f7 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:39.807987 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8a5f4771-e6a3-498b-8e67-069ebdcd08f7 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:39.950782 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.objects.instance [None req-8a5f4771-e6a3-498b-8e67-069ebdcd08f7 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lazy-loading 'services' on Instance uuid 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 {{(pid=123068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 09:51:40.127529 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-4bf77f49-369b-4914-824e-8d223bfa0ef1 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:40.128139 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-4bf77f49-369b-4914-824e-8d223bfa0ef1 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:40.138278 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4bf77f49-369b-4914-824e-8d223bfa0ef1 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:40.138278 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4bf77f49-369b-4914-824e-8d223bfa0ef1 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:40.138827 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4bf77f49-369b-4914-824e-8d223bfa0ef1 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:40.139252 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4bf77f49-369b-4914-824e-8d223bfa0ef1 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:40.276590 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-4bf77f49-369b-4914-824e-8d223bfa0ef1 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:40.286810 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-4bf77f49-369b-4914-824e-8d223bfa0ef1 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1362 microversion: 2.1 time: 0.161985 Oct 28 09:51:40.286810 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 206/403] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:40 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:40.313193 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-57cfb448-3186-490b-94b5-5dca1fb72db1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:40.314063 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-57cfb448-3186-490b-94b5-5dca1fb72db1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:40.320689 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-57cfb448-3186-490b-94b5-5dca1fb72db1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:40.321592 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-57cfb448-3186-490b-94b5-5dca1fb72db1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:40.322097 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-57cfb448-3186-490b-94b5-5dca1fb72db1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:40.322591 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-57cfb448-3186-490b-94b5-5dca1fb72db1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:40.370255 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-8a5f4771-e6a3-498b-8e67-069ebdcd08f7 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "DELETE /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/os-volume_attachments/b26924ac-4675-44b2-9475-c1e2c042dc92" status: 202 len: 0 microversion: 2.1 time: 0.576831 Oct 28 09:51:40.371225 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 198/404] 10.222.0.104 () {58 vars in 1420 bytes} [Thu Oct 28 09:51:39 2021] DELETE /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/os-volume_attachments/b26924ac-4675-44b2-9475-c1e2c042dc92 => generated 0 bytes in 580 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:51:40.448847 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-cb9da1e8-ea92-43e2-bf05-fa046c8515d0 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:40.449554 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-cb9da1e8-ea92-43e2-bf05-fa046c8515d0 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: 68f4383c-7f8e-4f49-9377-f11540e9f81e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:40.468901 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cb9da1e8-ea92-43e2-bf05-fa046c8515d0 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:40.469697 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cb9da1e8-ea92-43e2-bf05-fa046c8515d0 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:40.473738 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cb9da1e8-ea92-43e2-bf05-fa046c8515d0 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:40.474309 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cb9da1e8-ea92-43e2-bf05-fa046c8515d0 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:40.628601 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-cb9da1e8-ea92-43e2-bf05-fa046c8515d0 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:40.639195 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-cb9da1e8-ea92-43e2-bf05-fa046c8515d0 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e" status: 200 len: 1278 microversion: 2.1 time: 0.194531 Oct 28 09:51:40.640031 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 199/405] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:40 2021] GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e => generated 1278 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:40.654250 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-9ec62bfb-4335-4046-9870-31e163f0f87e tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:40.655410 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-57cfb448-3186-490b-94b5-5dca1fb72db1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:40.655604 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-9ec62bfb-4335-4046-9870-31e163f0f87e tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:40.662898 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9ec62bfb-4335-4046-9870-31e163f0f87e tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:40.663488 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9ec62bfb-4335-4046-9870-31e163f0f87e tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:40.664480 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9ec62bfb-4335-4046-9870-31e163f0f87e tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:40.665077 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9ec62bfb-4335-4046-9870-31e163f0f87e tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:40.670236 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-57cfb448-3186-490b-94b5-5dca1fb72db1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:40.673326 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-57cfb448-3186-490b-94b5-5dca1fb72db1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:40.674997 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-57cfb448-3186-490b-94b5-5dca1fb72db1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1754 microversion: 2.20 time: 0.365459 Oct 28 09:51:40.683195 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 207/406] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:51:40 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1754 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:40.726473 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-e7cbe0e2-e220-4653-8502-7ad9a61d117b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:40.727115 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-e7cbe0e2-e220-4653-8502-7ad9a61d117b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:40.734969 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e7cbe0e2-e220-4653-8502-7ad9a61d117b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:40.735801 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e7cbe0e2-e220-4653-8502-7ad9a61d117b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:40.737074 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e7cbe0e2-e220-4653-8502-7ad9a61d117b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:40.737928 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e7cbe0e2-e220-4653-8502-7ad9a61d117b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:40.937852 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-9ec62bfb-4335-4046-9870-31e163f0f87e tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:40.946034 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-9ec62bfb-4335-4046-9870-31e163f0f87e tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1263 microversion: 2.1 time: 0.304537 Oct 28 09:51:40.947949 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 200/407] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:40 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1263 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:41.005238 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-e7cbe0e2-e220-4653-8502-7ad9a61d117b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:41.015874 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-e7cbe0e2-e220-4653-8502-7ad9a61d117b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1515 microversion: 2.1 time: 0.293312 Oct 28 09:51:41.016819 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 208/408] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:40 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1515 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:41.304051 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-bac992c1-197f-45e7-9873-7a1c585b4dd4 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:41.304686 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-bac992c1-197f-45e7-9873-7a1c585b4dd4 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:41.311237 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bac992c1-197f-45e7-9873-7a1c585b4dd4 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:41.311710 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bac992c1-197f-45e7-9873-7a1c585b4dd4 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:41.312536 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bac992c1-197f-45e7-9873-7a1c585b4dd4 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:41.313012 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bac992c1-197f-45e7-9873-7a1c585b4dd4 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:41.529987 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-bac992c1-197f-45e7-9873-7a1c585b4dd4 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:41.538074 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-bac992c1-197f-45e7-9873-7a1c585b4dd4 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1362 microversion: 2.1 time: 0.238040 Oct 28 09:51:41.538726 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 201/409] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:41 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:41.657459 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-1ad1aea2-4ee0-4646-82c6-820ca87d6708 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:41.658215 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-1ad1aea2-4ee0-4646-82c6-820ca87d6708 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: 68f4383c-7f8e-4f49-9377-f11540e9f81e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:41.666438 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1ad1aea2-4ee0-4646-82c6-820ca87d6708 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:41.667187 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1ad1aea2-4ee0-4646-82c6-820ca87d6708 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:41.668088 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1ad1aea2-4ee0-4646-82c6-820ca87d6708 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:41.668826 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1ad1aea2-4ee0-4646-82c6-820ca87d6708 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:41.701747 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-aacbfda8-8c4d-4522-be90-b5ec21e65278 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:41.702381 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-aacbfda8-8c4d-4522-be90-b5ec21e65278 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:41.716976 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-aacbfda8-8c4d-4522-be90-b5ec21e65278 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:41.717435 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-aacbfda8-8c4d-4522-be90-b5ec21e65278 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:41.718227 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-aacbfda8-8c4d-4522-be90-b5ec21e65278 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:41.718664 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-aacbfda8-8c4d-4522-be90-b5ec21e65278 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:42.017108 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-aacbfda8-8c4d-4522-be90-b5ec21e65278 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:42.027400 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-aacbfda8-8c4d-4522-be90-b5ec21e65278 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:42.029187 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-aacbfda8-8c4d-4522-be90-b5ec21e65278 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:42.029435 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-1ad1aea2-4ee0-4646-82c6-820ca87d6708 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:42.030463 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-aacbfda8-8c4d-4522-be90-b5ec21e65278 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1756 microversion: 2.20 time: 0.333280 Oct 28 09:51:42.031790 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 202/410] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:51:41 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1756 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:51:42.036776 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-ec82209a-1e82-4200-9861-e3ad594166cf tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:42.037775 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-ec82209a-1e82-4200-9861-e3ad594166cf tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:42.044009 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-1ad1aea2-4ee0-4646-82c6-820ca87d6708 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e" status: 200 len: 1318 microversion: 2.1 time: 0.390510 Oct 28 09:51:42.044899 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 209/411] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:41 2021] GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e => generated 1318 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:42.049717 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ec82209a-1e82-4200-9861-e3ad594166cf tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:42.050454 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ec82209a-1e82-4200-9861-e3ad594166cf tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:42.051322 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-c4f14779-5cee-4538-b7ff-96cf96c0426e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:42.052189 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ec82209a-1e82-4200-9861-e3ad594166cf tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:42.052599 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-c4f14779-5cee-4538-b7ff-96cf96c0426e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:42.052988 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ec82209a-1e82-4200-9861-e3ad594166cf tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:42.061013 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c4f14779-5cee-4538-b7ff-96cf96c0426e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:42.061918 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c4f14779-5cee-4538-b7ff-96cf96c0426e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:42.062885 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c4f14779-5cee-4538-b7ff-96cf96c0426e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:42.063311 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c4f14779-5cee-4538-b7ff-96cf96c0426e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:42.528194 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-ec82209a-1e82-4200-9861-e3ad594166cf tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:42.539834 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-ec82209a-1e82-4200-9861-e3ad594166cf tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1263 microversion: 2.1 time: 0.506492 Oct 28 09:51:42.551059 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 203/412] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:42 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1263 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:42.559965 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-c4f14779-5cee-4538-b7ff-96cf96c0426e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:42.562504 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-e08eca46-51e3-4bdf-addd-a9eba6663d85 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:42.563209 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-e08eca46-51e3-4bdf-addd-a9eba6663d85 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:42.579633 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e08eca46-51e3-4bdf-addd-a9eba6663d85 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:42.580134 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e08eca46-51e3-4bdf-addd-a9eba6663d85 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:42.581253 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e08eca46-51e3-4bdf-addd-a9eba6663d85 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:42.582049 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e08eca46-51e3-4bdf-addd-a9eba6663d85 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:42.593520 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-c4f14779-5cee-4538-b7ff-96cf96c0426e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1515 microversion: 2.1 time: 0.547755 Oct 28 09:51:42.594141 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 210/413] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:42 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1515 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:42.652487 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-45503cd9-ca4a-47c8-bfd4-30425d372c6e tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:42.659904 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-45503cd9-ca4a-47c8-bfd4-30425d372c6e tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:42.661352 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-45503cd9-ca4a-47c8-bfd4-30425d372c6e tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:42.695867 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-45503cd9-ca4a-47c8-bfd4-30425d372c6e tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Going to try to stop instance {{(pid=123069) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Oct 28 09:51:42.801869 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-e08eca46-51e3-4bdf-addd-a9eba6663d85 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:42.818726 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-e08eca46-51e3-4bdf-addd-a9eba6663d85 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1362 microversion: 2.1 time: 0.264182 Oct 28 09:51:42.819312 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 204/414] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:42 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1362 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:51:42.865414 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-616fa2d8-36cd-4996-a12d-728e28ec8aaf req-6879a50d-1975-4e10-8dcc-29e96ff53b5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d623582-8352-4294-9aca-086539f32232", "name": "network-vif-plugged", "status": "completed", "tag": "cbe862a5-40a7-43ef-b2b3-73aad1487228"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:42.867844 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:51:42.867844 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:51:42.878063 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-616fa2d8-36cd-4996-a12d-728e28ec8aaf req-6879a50d-1975-4e10-8dcc-29e96ff53b5c service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:42.878507 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-616fa2d8-36cd-4996-a12d-728e28ec8aaf req-6879a50d-1975-4e10-8dcc-29e96ff53b5c service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:42.894634 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-616fa2d8-36cd-4996-a12d-728e28ec8aaf req-6879a50d-1975-4e10-8dcc-29e96ff53b5c service nova] Creating event network-vif-plugged:cbe862a5-40a7-43ef-b2b3-73aad1487228 for instance 2d623582-8352-4294-9aca-086539f32232 on hv-cinder-81571 Oct 28 09:51:42.900932 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-616fa2d8-36cd-4996-a12d-728e28ec8aaf req-6879a50d-1975-4e10-8dcc-29e96ff53b5c service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038337 Oct 28 09:51:42.902281 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 205/415] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:51:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:51:42.952586 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-45503cd9-ca4a-47c8-bfd4-30425d372c6e tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 202 len: 0 microversion: 2.1 time: 0.304288 Oct 28 09:51:42.953396 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 211/416] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:51:42 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:51:42.988615 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-9dc8a647-836f-43b3-8414-ce6840afd6fa tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:42.988615 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-9dc8a647-836f-43b3-8414-ce6840afd6fa tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:42.994961 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [req-e4fd7507-f70f-4029-b987-504375972cdb req-766b2ecf-ccc8-406f-b979-eb6023138b97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68f4383c-7f8e-4f49-9377-f11540e9f81e", "tag": "b9d6f69f-6582-4e12-8137-5f6aa83f2874"}]} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:42.999698 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:51:42.999698 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 09:51:43.005815 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9dc8a647-836f-43b3-8414-ce6840afd6fa tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:43.006269 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9dc8a647-836f-43b3-8414-ce6840afd6fa tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:43.009078 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9dc8a647-836f-43b3-8414-ce6840afd6fa tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:43.009454 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9dc8a647-836f-43b3-8414-ce6840afd6fa tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:43.016372 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-e4fd7507-f70f-4029-b987-504375972cdb req-766b2ecf-ccc8-406f-b979-eb6023138b97 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:43.017793 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-e4fd7507-f70f-4029-b987-504375972cdb req-766b2ecf-ccc8-406f-b979-eb6023138b97 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:43.032093 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.compute.server_external_events [req-e4fd7507-f70f-4029-b987-504375972cdb req-766b2ecf-ccc8-406f-b979-eb6023138b97 service nova] Creating event network-changed:b9d6f69f-6582-4e12-8137-5f6aa83f2874 for instance 68f4383c-7f8e-4f49-9377-f11540e9f81e on hv-cinder-81571 Oct 28 09:51:43.039198 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [req-e4fd7507-f70f-4029-b987-504375972cdb req-766b2ecf-ccc8-406f-b979-eb6023138b97 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050977 Oct 28 09:51:43.041166 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 212/417] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:51:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:43.066129 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-fe2de791-0d5e-4e19-ad97-9c83463fd3d9 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:43.067336 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-fe2de791-0d5e-4e19-ad97-9c83463fd3d9 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:43.077575 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fe2de791-0d5e-4e19-ad97-9c83463fd3d9 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:43.078509 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fe2de791-0d5e-4e19-ad97-9c83463fd3d9 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:43.079315 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fe2de791-0d5e-4e19-ad97-9c83463fd3d9 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:43.079746 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fe2de791-0d5e-4e19-ad97-9c83463fd3d9 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:43.396677 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-9dc8a647-836f-43b3-8414-ce6840afd6fa tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:43.404712 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-9dc8a647-836f-43b3-8414-ce6840afd6fa tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1681 microversion: 2.1 time: 0.445718 Oct 28 09:51:43.405383 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 206/418] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:42 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1681 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:43.409747 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-fe2de791-0d5e-4e19-ad97-9c83463fd3d9 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:43.410277 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-57e77830-8674-4e92-a011-3c6c1805afc9 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:43.410986 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-57e77830-8674-4e92-a011-3c6c1805afc9 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: 68f4383c-7f8e-4f49-9377-f11540e9f81e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:43.418606 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-57e77830-8674-4e92-a011-3c6c1805afc9 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:43.419428 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-57e77830-8674-4e92-a011-3c6c1805afc9 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:43.419971 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-fe2de791-0d5e-4e19-ad97-9c83463fd3d9 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:43.420686 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-57e77830-8674-4e92-a011-3c6c1805afc9 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:43.421129 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-57e77830-8674-4e92-a011-3c6c1805afc9 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:43.429511 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-fe2de791-0d5e-4e19-ad97-9c83463fd3d9 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:43.431715 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-fe2de791-0d5e-4e19-ad97-9c83463fd3d9 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1756 microversion: 2.20 time: 0.381336 Oct 28 09:51:43.443361 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 213/419] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:51:43 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1756 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:43.558602 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-e1d8d1f9-cd30-4b10-9a24-7f1743491b32 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:43.559212 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-e1d8d1f9-cd30-4b10-9a24-7f1743491b32 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:43.565407 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e1d8d1f9-cd30-4b10-9a24-7f1743491b32 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:43.565844 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e1d8d1f9-cd30-4b10-9a24-7f1743491b32 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:43.566818 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e1d8d1f9-cd30-4b10-9a24-7f1743491b32 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:43.567354 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e1d8d1f9-cd30-4b10-9a24-7f1743491b32 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:43.607652 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-57e77830-8674-4e92-a011-3c6c1805afc9 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:43.615291 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-57e77830-8674-4e92-a011-3c6c1805afc9 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e" status: 200 len: 1318 microversion: 2.1 time: 0.208880 Oct 28 09:51:43.615872 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 207/420] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:43 2021] GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:43.621026 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-7f379431-4f63-4035-a62b-62ef43f81d45 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:43.621631 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-7f379431-4f63-4035-a62b-62ef43f81d45 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:43.628208 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7f379431-4f63-4035-a62b-62ef43f81d45 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:43.628898 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7f379431-4f63-4035-a62b-62ef43f81d45 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:43.629855 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7f379431-4f63-4035-a62b-62ef43f81d45 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:43.630565 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7f379431-4f63-4035-a62b-62ef43f81d45 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:43.771230 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-e1d8d1f9-cd30-4b10-9a24-7f1743491b32 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:43.780379 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-e1d8d1f9-cd30-4b10-9a24-7f1743491b32 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1263 microversion: 2.1 time: 0.225005 Oct 28 09:51:43.780892 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 214/421] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:43 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1263 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:51:43.835850 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-bafe091b-8df8-427f-bdd4-0f92ad0280ce tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:43.836490 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-bafe091b-8df8-427f-bdd4-0f92ad0280ce tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:43.843755 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bafe091b-8df8-427f-bdd4-0f92ad0280ce tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:43.844209 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bafe091b-8df8-427f-bdd4-0f92ad0280ce tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:43.845070 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bafe091b-8df8-427f-bdd4-0f92ad0280ce tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:43.845491 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bafe091b-8df8-427f-bdd4-0f92ad0280ce tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:43.871624 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-7f379431-4f63-4035-a62b-62ef43f81d45 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:43.879737 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-7f379431-4f63-4035-a62b-62ef43f81d45 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1521 microversion: 2.1 time: 0.262347 Oct 28 09:51:43.880335 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 208/422] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:43 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:44.088708 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-bafe091b-8df8-427f-bdd4-0f92ad0280ce tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:44.095949 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-bafe091b-8df8-427f-bdd4-0f92ad0280ce tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1362 microversion: 2.1 time: 0.264197 Oct 28 09:51:44.096526 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 215/423] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:43 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1362 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:51:44.423827 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-b606acfc-8e58-4c9c-9876-0c8fed9a57d8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:44.424644 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-b606acfc-8e58-4c9c-9876-0c8fed9a57d8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:44.433218 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b606acfc-8e58-4c9c-9876-0c8fed9a57d8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:44.433816 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b606acfc-8e58-4c9c-9876-0c8fed9a57d8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:44.434855 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b606acfc-8e58-4c9c-9876-0c8fed9a57d8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:44.435293 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b606acfc-8e58-4c9c-9876-0c8fed9a57d8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:44.453419 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-95f956d4-9758-42c4-bd15-f1c01a549ffb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:44.457373 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-95f956d4-9758-42c4-bd15-f1c01a549ffb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:44.461572 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-95f956d4-9758-42c4-bd15-f1c01a549ffb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:44.461572 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-95f956d4-9758-42c4-bd15-f1c01a549ffb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:44.462379 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-95f956d4-9758-42c4-bd15-f1c01a549ffb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:44.462871 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-95f956d4-9758-42c4-bd15-f1c01a549ffb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:44.643619 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-b606acfc-8e58-4c9c-9876-0c8fed9a57d8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:44.653342 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-b606acfc-8e58-4c9c-9876-0c8fed9a57d8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1681 microversion: 2.1 time: 0.233224 Oct 28 09:51:44.657205 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 209/424] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:44 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1681 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:44.672308 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-4b740237-915b-44a1-9f79-6f61a2136c24 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:44.673848 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-4b740237-915b-44a1-9f79-6f61a2136c24 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: 68f4383c-7f8e-4f49-9377-f11540e9f81e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:44.687129 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4b740237-915b-44a1-9f79-6f61a2136c24 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:44.687583 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4b740237-915b-44a1-9f79-6f61a2136c24 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:44.688366 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4b740237-915b-44a1-9f79-6f61a2136c24 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:44.690159 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4b740237-915b-44a1-9f79-6f61a2136c24 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:44.694624 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-95f956d4-9758-42c4-bd15-f1c01a549ffb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:44.713243 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-95f956d4-9758-42c4-bd15-f1c01a549ffb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:44.720513 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-95f956d4-9758-42c4-bd15-f1c01a549ffb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:44.721763 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-95f956d4-9758-42c4-bd15-f1c01a549ffb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1812 microversion: 2.20 time: 0.273841 Oct 28 09:51:44.722325 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 216/425] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:51:44 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1812 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:44.798116 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-9b95a665-4f30-4805-8404-2741d5ec8a7b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:44.798904 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-9b95a665-4f30-4805-8404-2741d5ec8a7b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:44.806930 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9b95a665-4f30-4805-8404-2741d5ec8a7b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:44.811368 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9b95a665-4f30-4805-8404-2741d5ec8a7b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:44.812712 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9b95a665-4f30-4805-8404-2741d5ec8a7b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:44.813426 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9b95a665-4f30-4805-8404-2741d5ec8a7b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:44.935570 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-4b740237-915b-44a1-9f79-6f61a2136c24 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:44.944151 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-4b740237-915b-44a1-9f79-6f61a2136c24 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e" status: 200 len: 1318 microversion: 2.1 time: 0.285651 Oct 28 09:51:44.945051 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 210/426] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:44 2021] GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e => generated 1318 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:45.003280 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-9b95a665-4f30-4805-8404-2741d5ec8a7b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:45.010804 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-9b95a665-4f30-4805-8404-2741d5ec8a7b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1263 microversion: 2.1 time: 0.216820 Oct 28 09:51:45.011593 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 217/427] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:44 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1263 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:51:45.113431 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-ac39b9d9-7804-4cdb-ab27-2cab6d865d98 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:45.113942 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-ac39b9d9-7804-4cdb-ab27-2cab6d865d98 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:45.119745 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ac39b9d9-7804-4cdb-ab27-2cab6d865d98 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:45.120183 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ac39b9d9-7804-4cdb-ab27-2cab6d865d98 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:45.121007 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ac39b9d9-7804-4cdb-ab27-2cab6d865d98 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:45.121435 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ac39b9d9-7804-4cdb-ab27-2cab6d865d98 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:45.247512 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-ac39b9d9-7804-4cdb-ab27-2cab6d865d98 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:45.265100 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-ac39b9d9-7804-4cdb-ab27-2cab6d865d98 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1362 microversion: 2.1 time: 0.155199 Oct 28 09:51:45.265713 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 211/428] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:45 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:45.684421 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-941943eb-436f-489f-a605-50f31fcdc866 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:45.684421 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-941943eb-436f-489f-a605-50f31fcdc866 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:45.684421 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-941943eb-436f-489f-a605-50f31fcdc866 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:45.684421 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-941943eb-436f-489f-a605-50f31fcdc866 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:45.685301 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-941943eb-436f-489f-a605-50f31fcdc866 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:45.685301 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-941943eb-436f-489f-a605-50f31fcdc866 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:45.740427 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-f74aa088-a789-45d7-bdbf-4b209d343498 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:45.741502 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-f74aa088-a789-45d7-bdbf-4b209d343498 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:45.769657 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f74aa088-a789-45d7-bdbf-4b209d343498 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:45.772998 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f74aa088-a789-45d7-bdbf-4b209d343498 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:45.778030 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f74aa088-a789-45d7-bdbf-4b209d343498 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:45.779986 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f74aa088-a789-45d7-bdbf-4b209d343498 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:45.949436 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-941943eb-436f-489f-a605-50f31fcdc866 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:45.960520 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-941943eb-436f-489f-a605-50f31fcdc866 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1681 microversion: 2.1 time: 0.289773 Oct 28 09:51:45.962423 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 218/429] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:45 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1681 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:45.967715 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-eca5d370-ba7d-47b7-84e7-162e4304b278 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:45.968578 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-eca5d370-ba7d-47b7-84e7-162e4304b278 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:45.979856 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-eca5d370-ba7d-47b7-84e7-162e4304b278 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:45.980794 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-eca5d370-ba7d-47b7-84e7-162e4304b278 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:45.982014 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-eca5d370-ba7d-47b7-84e7-162e4304b278 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:45.982895 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-eca5d370-ba7d-47b7-84e7-162e4304b278 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:46.088184 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-f74aa088-a789-45d7-bdbf-4b209d343498 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:46.101443 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-f74aa088-a789-45d7-bdbf-4b209d343498 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:46.104567 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-f74aa088-a789-45d7-bdbf-4b209d343498 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:46.105985 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-f74aa088-a789-45d7-bdbf-4b209d343498 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1812 microversion: 2.20 time: 0.369212 Oct 28 09:51:46.106524 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 212/430] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:51:45 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1812 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:51:46.113717 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-78cc35d3-c38a-4e6c-85db-23d7f105e2cd tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:46.121899 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-78cc35d3-c38a-4e6c-85db-23d7f105e2cd tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: 68f4383c-7f8e-4f49-9377-f11540e9f81e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:46.123646 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-78cc35d3-c38a-4e6c-85db-23d7f105e2cd tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:46.124093 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-78cc35d3-c38a-4e6c-85db-23d7f105e2cd tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:46.124940 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-78cc35d3-c38a-4e6c-85db-23d7f105e2cd tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:46.125716 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-78cc35d3-c38a-4e6c-85db-23d7f105e2cd tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:46.206282 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-eca5d370-ba7d-47b7-84e7-162e4304b278 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:46.216468 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-eca5d370-ba7d-47b7-84e7-162e4304b278 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1521 microversion: 2.1 time: 0.252302 Oct 28 09:51:46.230468 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 219/431] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:45 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:46.235863 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-d4b8ec83-b1c6-4813-a2e7-5c3de4846a70 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:46.236602 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-d4b8ec83-b1c6-4813-a2e7-5c3de4846a70 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:46.244963 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d4b8ec83-b1c6-4813-a2e7-5c3de4846a70 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:46.245798 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d4b8ec83-b1c6-4813-a2e7-5c3de4846a70 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:46.246825 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d4b8ec83-b1c6-4813-a2e7-5c3de4846a70 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:46.247475 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d4b8ec83-b1c6-4813-a2e7-5c3de4846a70 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:46.390395 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-78cc35d3-c38a-4e6c-85db-23d7f105e2cd tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:46.400858 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-78cc35d3-c38a-4e6c-85db-23d7f105e2cd tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e" status: 200 len: 1318 microversion: 2.1 time: 0.292970 Oct 28 09:51:46.406060 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 213/432] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:46 2021] GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:46.416419 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-bac53919-cff5-4270-a257-89a4451bf26f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3c0c6bc-ff53-496a-867d-e61518764421"}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:46.417649 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-bac53919-cff5-4270-a257-89a4451bf26f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:46.425574 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bac53919-cff5-4270-a257-89a4451bf26f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:46.426152 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bac53919-cff5-4270-a257-89a4451bf26f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:46.427357 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bac53919-cff5-4270-a257-89a4451bf26f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:46.428095 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bac53919-cff5-4270-a257-89a4451bf26f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:46.480849 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-d4b8ec83-b1c6-4813-a2e7-5c3de4846a70 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:46.494822 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-d4b8ec83-b1c6-4813-a2e7-5c3de4846a70 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1263 microversion: 2.1 time: 0.262636 Oct 28 09:51:46.496738 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 220/433] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:46 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1263 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:46.511790 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-8e1f55dd-55aa-4f19-af37-335ce36968e6 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:46.512589 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-8e1f55dd-55aa-4f19-af37-335ce36968e6 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:46.519634 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8e1f55dd-55aa-4f19-af37-335ce36968e6 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:46.520186 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8e1f55dd-55aa-4f19-af37-335ce36968e6 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:46.521248 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8e1f55dd-55aa-4f19-af37-335ce36968e6 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:46.521865 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8e1f55dd-55aa-4f19-af37-335ce36968e6 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:46.699160 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-8e1f55dd-55aa-4f19-af37-335ce36968e6 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:46.708953 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-8e1f55dd-55aa-4f19-af37-335ce36968e6 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1552 microversion: 2.1 time: 0.210817 Oct 28 09:51:46.709709 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 221/434] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:46 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1552 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:46.731005 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-cd501335-76cd-411f-9332-8e8e87949cb9 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:46.731667 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-cd501335-76cd-411f-9332-8e8e87949cb9 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:46.739087 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-cd501335-76cd-411f-9332-8e8e87949cb9 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:46.739746 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-cd501335-76cd-411f-9332-8e8e87949cb9 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:46.740870 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-cd501335-76cd-411f-9332-8e8e87949cb9 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:46.741107 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-cd501335-76cd-411f-9332-8e8e87949cb9 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:46.880779 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-cd501335-76cd-411f-9332-8e8e87949cb9 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:46.891420 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-cd501335-76cd-411f-9332-8e8e87949cb9 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1552 microversion: 2.1 time: 0.167294 Oct 28 09:51:46.892053 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 222/435] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:46 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1552 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:51:46.908871 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-314f9fe6-a485-461d-bcb3-9dd352b74be9 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:46.912775 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:51:46.912775 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 09:51:46.914073 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-314f9fe6-a485-461d-bcb3-9dd352b74be9 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:46.915415 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-314f9fe6-a485-461d-bcb3-9dd352b74be9 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Searching by: {'deleted': False, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1'} {{(pid=123069) get_all /opt/stack/nova/nova/compute/api.py:2905}} Oct 28 09:51:46.923288 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-314f9fe6-a485-461d-bcb3-9dd352b74be9 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:46.923721 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-314f9fe6-a485-461d-bcb3-9dd352b74be9 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:46.924518 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-314f9fe6-a485-461d-bcb3-9dd352b74be9 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:46.924964 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-314f9fe6-a485-461d-bcb3-9dd352b74be9 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:47.035380 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.multi_cell_list [None req-314f9fe6-a485-461d-bcb3-9dd352b74be9 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123069) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Oct 28 09:51:47.132949 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-314f9fe6-a485-461d-bcb3-9dd352b74be9 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.227525 Oct 28 09:51:47.133611 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 223/436] 10.222.0.104 () {58 vars in 1129 bytes} [Thu Oct 28 09:51:46 2021] GET /compute/v2.1/servers => generated 344 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:51:47.138028 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-2abddc30-2073-435f-b85d-87baa71aa1c0 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:47.138710 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-2abddc30-2073-435f-b85d-87baa71aa1c0 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:47.144627 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2abddc30-2073-435f-b85d-87baa71aa1c0 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:47.145091 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2abddc30-2073-435f-b85d-87baa71aa1c0 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:47.145857 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2abddc30-2073-435f-b85d-87baa71aa1c0 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:47.146274 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2abddc30-2073-435f-b85d-87baa71aa1c0 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:47.297545 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-2abddc30-2073-435f-b85d-87baa71aa1c0 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:47.306487 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-2abddc30-2073-435f-b85d-87baa71aa1c0 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1681 microversion: 2.1 time: 0.171800 Oct 28 09:51:47.317690 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 224/437] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:47 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:47.317690 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-9ae074a3-adf9-4630-8f93-18ef6c3cf3b6 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:47.317690 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-9ae074a3-adf9-4630-8f93-18ef6c3cf3b6 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:47.324014 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9ae074a3-adf9-4630-8f93-18ef6c3cf3b6 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:47.324530 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9ae074a3-adf9-4630-8f93-18ef6c3cf3b6 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:47.325412 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9ae074a3-adf9-4630-8f93-18ef6c3cf3b6 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:47.325909 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9ae074a3-adf9-4630-8f93-18ef6c3cf3b6 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:47.470832 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-9ae074a3-adf9-4630-8f93-18ef6c3cf3b6 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:47.481248 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-9ae074a3-adf9-4630-8f93-18ef6c3cf3b6 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:47.483992 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-9ae074a3-adf9-4630-8f93-18ef6c3cf3b6 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:47.483992 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-9ae074a3-adf9-4630-8f93-18ef6c3cf3b6 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1812 microversion: 2.20 time: 0.175164 Oct 28 09:51:47.484491 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 225/438] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:51:47 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1812 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:47.489203 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-7c939b04-5c00-4868-99ec-ee1855ddf16d tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:47.489799 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-7c939b04-5c00-4868-99ec-ee1855ddf16d tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:47.497190 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7c939b04-5c00-4868-99ec-ee1855ddf16d tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:47.497550 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7c939b04-5c00-4868-99ec-ee1855ddf16d tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:47.498321 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7c939b04-5c00-4868-99ec-ee1855ddf16d tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:47.498739 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7c939b04-5c00-4868-99ec-ee1855ddf16d tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:47.630360 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-7c939b04-5c00-4868-99ec-ee1855ddf16d tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:47.639621 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-7c939b04-5c00-4868-99ec-ee1855ddf16d tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1552 microversion: 2.1 time: 0.153996 Oct 28 09:51:47.651662 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 226/439] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:47 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1552 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:47.657148 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-4996621a-6183-4a40-b0c2-29e262ab13a5 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:47.657287 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-4996621a-6183-4a40-b0c2-29e262ab13a5 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: 68f4383c-7f8e-4f49-9377-f11540e9f81e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:47.663872 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4996621a-6183-4a40-b0c2-29e262ab13a5 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:47.664314 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4996621a-6183-4a40-b0c2-29e262ab13a5 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:47.665497 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4996621a-6183-4a40-b0c2-29e262ab13a5 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:47.666045 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4996621a-6183-4a40-b0c2-29e262ab13a5 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:47.816786 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-4996621a-6183-4a40-b0c2-29e262ab13a5 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:47.825261 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-4996621a-6183-4a40-b0c2-29e262ab13a5 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e" status: 200 len: 1318 microversion: 2.1 time: 0.172475 Oct 28 09:51:47.826063 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 227/440] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:47 2021] GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:47.830084 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-fa65092f-989b-4c69-b1f2-75fc5690864a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:47.830699 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-fa65092f-989b-4c69-b1f2-75fc5690864a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:47.841707 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fa65092f-989b-4c69-b1f2-75fc5690864a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:47.842151 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fa65092f-989b-4c69-b1f2-75fc5690864a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:47.842940 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fa65092f-989b-4c69-b1f2-75fc5690864a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:47.843366 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fa65092f-989b-4c69-b1f2-75fc5690864a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:48.162681 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-fa65092f-989b-4c69-b1f2-75fc5690864a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:48.162681 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-fa65092f-989b-4c69-b1f2-75fc5690864a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1263 microversion: 2.1 time: 0.166738 Oct 28 09:51:48.162681 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 228/441] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:47 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1263 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:48.335593 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-8259cdd5-4d55-46df-85aa-208d4d905481 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:48.337103 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-8259cdd5-4d55-46df-85aa-208d4d905481 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:48.344513 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8259cdd5-4d55-46df-85aa-208d4d905481 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:48.345078 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8259cdd5-4d55-46df-85aa-208d4d905481 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:48.345879 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8259cdd5-4d55-46df-85aa-208d4d905481 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:48.346315 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8259cdd5-4d55-46df-85aa-208d4d905481 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:48.482711 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-8259cdd5-4d55-46df-85aa-208d4d905481 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:48.495129 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-8259cdd5-4d55-46df-85aa-208d4d905481 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1681 microversion: 2.1 time: 0.160617 Oct 28 09:51:48.505217 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 229/442] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:48 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:51:48.505217 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-4665ea18-0f3c-4690-8ccf-3787a8ecd3f5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:48.505217 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-4665ea18-0f3c-4690-8ccf-3787a8ecd3f5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:48.509610 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4665ea18-0f3c-4690-8ccf-3787a8ecd3f5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:48.509871 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4665ea18-0f3c-4690-8ccf-3787a8ecd3f5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:48.510653 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4665ea18-0f3c-4690-8ccf-3787a8ecd3f5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:48.511233 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4665ea18-0f3c-4690-8ccf-3787a8ecd3f5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:48.739641 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-4665ea18-0f3c-4690-8ccf-3787a8ecd3f5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:48.749948 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-4665ea18-0f3c-4690-8ccf-3787a8ecd3f5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:48.752056 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-4665ea18-0f3c-4690-8ccf-3787a8ecd3f5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:48.752749 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-4665ea18-0f3c-4690-8ccf-3787a8ecd3f5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1812 microversion: 2.20 time: 0.254059 Oct 28 09:51:48.765465 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 230/443] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:51:48 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1812 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:51:48.843872 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-6b9c5754-e1d5-4153-bc7c-9e213ba30ac0 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:48.844823 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-6b9c5754-e1d5-4153-bc7c-9e213ba30ac0 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: 68f4383c-7f8e-4f49-9377-f11540e9f81e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:48.857785 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6b9c5754-e1d5-4153-bc7c-9e213ba30ac0 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:48.857785 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6b9c5754-e1d5-4153-bc7c-9e213ba30ac0 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:48.857785 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6b9c5754-e1d5-4153-bc7c-9e213ba30ac0 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:48.857785 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6b9c5754-e1d5-4153-bc7c-9e213ba30ac0 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:49.012679 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-6b9c5754-e1d5-4153-bc7c-9e213ba30ac0 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:49.020443 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-6b9c5754-e1d5-4153-bc7c-9e213ba30ac0 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e" status: 200 len: 1318 microversion: 2.1 time: 0.180285 Oct 28 09:51:49.021059 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 231/444] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:48 2021] GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:49.025951 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-10788cb1-656a-45af-baad-cfebdbc0478e tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:49.026559 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-10788cb1-656a-45af-baad-cfebdbc0478e tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:49.032383 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-10788cb1-656a-45af-baad-cfebdbc0478e tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:49.032865 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-10788cb1-656a-45af-baad-cfebdbc0478e tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:49.044712 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-10788cb1-656a-45af-baad-cfebdbc0478e tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:49.044712 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-10788cb1-656a-45af-baad-cfebdbc0478e tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:49.171890 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-10788cb1-656a-45af-baad-cfebdbc0478e tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:49.179655 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-10788cb1-656a-45af-baad-cfebdbc0478e tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1263 microversion: 2.1 time: 0.157579 Oct 28 09:51:49.184430 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 232/445] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:49 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:49.513737 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-1325819a-4c10-4667-9940-3d13bbed3aef tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:49.514330 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-1325819a-4c10-4667-9940-3d13bbed3aef tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:49.520739 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1325819a-4c10-4667-9940-3d13bbed3aef tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:49.521197 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1325819a-4c10-4667-9940-3d13bbed3aef tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:49.522002 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1325819a-4c10-4667-9940-3d13bbed3aef tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:49.522434 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1325819a-4c10-4667-9940-3d13bbed3aef tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:49.679717 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-1325819a-4c10-4667-9940-3d13bbed3aef tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:49.692025 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-1325819a-4c10-4667-9940-3d13bbed3aef tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1681 microversion: 2.1 time: 0.181864 Oct 28 09:51:49.693047 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 233/446] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:49 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1681 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:51:49.772730 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-e432be03-e654-4a94-b47d-2c1d018b074d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:49.773339 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-e432be03-e654-4a94-b47d-2c1d018b074d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:49.779976 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e432be03-e654-4a94-b47d-2c1d018b074d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:49.780456 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e432be03-e654-4a94-b47d-2c1d018b074d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:49.781300 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e432be03-e654-4a94-b47d-2c1d018b074d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:49.781766 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e432be03-e654-4a94-b47d-2c1d018b074d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:49.924058 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-e432be03-e654-4a94-b47d-2c1d018b074d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:49.934973 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-e432be03-e654-4a94-b47d-2c1d018b074d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:49.937325 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-e432be03-e654-4a94-b47d-2c1d018b074d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:49.938673 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-e432be03-e654-4a94-b47d-2c1d018b074d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1812 microversion: 2.20 time: 0.169923 Oct 28 09:51:49.939612 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 234/447] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:51:49 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1812 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:51:50.040306 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-6307eb96-0aa4-4d4b-b214-7930f564a727 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:50.040306 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-6307eb96-0aa4-4d4b-b214-7930f564a727 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: 68f4383c-7f8e-4f49-9377-f11540e9f81e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:50.060001 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6307eb96-0aa4-4d4b-b214-7930f564a727 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:50.061351 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6307eb96-0aa4-4d4b-b214-7930f564a727 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:50.061351 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6307eb96-0aa4-4d4b-b214-7930f564a727 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:50.061787 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6307eb96-0aa4-4d4b-b214-7930f564a727 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:50.201948 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-6307eb96-0aa4-4d4b-b214-7930f564a727 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:50.212100 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-6307eb96-0aa4-4d4b-b214-7930f564a727 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e" status: 200 len: 1318 microversion: 2.1 time: 0.177389 Oct 28 09:51:50.221604 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 235/448] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:50 2021] GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:51:50.221604 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-ce9322fe-9670-4a8a-b659-12c88d926202 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ea7b375-edd3-45d2-aacb-aada52e44d43"}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:50.221604 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-ce9322fe-9670-4a8a-b659-12c88d926202 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:50.229064 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ce9322fe-9670-4a8a-b659-12c88d926202 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:50.229499 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ce9322fe-9670-4a8a-b659-12c88d926202 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:50.230614 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ce9322fe-9670-4a8a-b659-12c88d926202 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:50.231099 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ce9322fe-9670-4a8a-b659-12c88d926202 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:56.362544 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 09:51:56.394678 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: Thu Oct 28 09:51:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f/os-volume_attachments (ip 10.222.0.104) !!! Oct 28 09:51:58.753180 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-ce9322fe-9670-4a8a-b659-12c88d926202 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "POST /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.538414 Oct 28 09:51:58.753824 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 236/449] 10.222.0.104 () {60 vars in 1327 bytes} [Thu Oct 28 09:51:50 2021] POST /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232/os-volume_attachments => generated 194 bytes in 8540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:58.758877 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-c4a546cc-d100-46cd-bda0-44592b245785 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:58.760619 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-c4a546cc-d100-46cd-bda0-44592b245785 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:58.767181 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c4a546cc-d100-46cd-bda0-44592b245785 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:58.767632 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c4a546cc-d100-46cd-bda0-44592b245785 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:58.768528 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c4a546cc-d100-46cd-bda0-44592b245785 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:58.769358 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c4a546cc-d100-46cd-bda0-44592b245785 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:58.823574 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-bac53919-cff5-4270-a257-89a4451bf26f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "POST /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 12.416493 Oct 28 09:51:58.829450 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 214/450] 10.222.0.104 () {60 vars in 1327 bytes} [Thu Oct 28 09:51:46 2021] POST /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f/os-volume_attachments => generated 194 bytes in 12423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:58.835213 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-88533617-c5d6-42d7-bdd4-62f40b834475 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:58.835931 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-88533617-c5d6-42d7-bdd4-62f40b834475 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:58.853603 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-88533617-c5d6-42d7-bdd4-62f40b834475 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:58.854321 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-88533617-c5d6-42d7-bdd4-62f40b834475 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:58.855170 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-88533617-c5d6-42d7-bdd4-62f40b834475 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:58.856061 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-88533617-c5d6-42d7-bdd4-62f40b834475 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:58.958964 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-c4a546cc-d100-46cd-bda0-44592b245785 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:58.969549 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-c4a546cc-d100-46cd-bda0-44592b245785 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1263 microversion: 2.1 time: 0.214615 Oct 28 09:51:58.970221 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 237/451] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:58 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1263 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:58.975362 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [req-0df02404-ce3d-4235-b38a-2465d46d1f95 req-c16cbde7-ad40-4f9c-b0d6-6f88dcf1a6b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f4383c-7f8e-4f49-9377-f11540e9f81e", "name": "network-vif-plugged", "status": "completed", "tag": "b9d6f69f-6582-4e12-8137-5f6aa83f2874"}]} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:58.977087 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:51:58.977087 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 09:51:58.985595 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-0df02404-ce3d-4235-b38a-2465d46d1f95 req-c16cbde7-ad40-4f9c-b0d6-6f88dcf1a6b0 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:58.986252 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-0df02404-ce3d-4235-b38a-2465d46d1f95 req-c16cbde7-ad40-4f9c-b0d6-6f88dcf1a6b0 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:58.998819 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.compute.server_external_events [req-0df02404-ce3d-4235-b38a-2465d46d1f95 req-c16cbde7-ad40-4f9c-b0d6-6f88dcf1a6b0 service nova] Creating event network-vif-plugged:b9d6f69f-6582-4e12-8137-5f6aa83f2874 for instance 68f4383c-7f8e-4f49-9377-f11540e9f81e on hv-cinder-81571 Oct 28 09:51:59.003933 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [req-0df02404-ce3d-4235-b38a-2465d46d1f95 req-c16cbde7-ad40-4f9c-b0d6-6f88dcf1a6b0 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032435 Oct 28 09:51:59.004858 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 238/452] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:51:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:59.010891 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-652381f0-c0fd-449b-94f4-76aba0606841 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:59.011618 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-652381f0-c0fd-449b-94f4-76aba0606841 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:59.019063 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-652381f0-c0fd-449b-94f4-76aba0606841 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:59.019517 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-652381f0-c0fd-449b-94f4-76aba0606841 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:59.020311 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-652381f0-c0fd-449b-94f4-76aba0606841 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:59.020797 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-652381f0-c0fd-449b-94f4-76aba0606841 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:59.038884 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-88533617-c5d6-42d7-bdd4-62f40b834475 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:59.048384 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-88533617-c5d6-42d7-bdd4-62f40b834475 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1658 microversion: 2.1 time: 0.217202 Oct 28 09:51:59.049422 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 215/453] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:58 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1658 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:59.054450 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-61412c67-3750-4a64-ae78-2faa46e21155 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:59.062274 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-61412c67-3750-4a64-ae78-2faa46e21155 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: 68f4383c-7f8e-4f49-9377-f11540e9f81e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:59.062274 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-61412c67-3750-4a64-ae78-2faa46e21155 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:59.062583 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-61412c67-3750-4a64-ae78-2faa46e21155 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:59.064044 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-61412c67-3750-4a64-ae78-2faa46e21155 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:59.064543 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-61412c67-3750-4a64-ae78-2faa46e21155 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:59.230300 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-652381f0-c0fd-449b-94f4-76aba0606841 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:59.239210 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-652381f0-c0fd-449b-94f4-76aba0606841 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:59.240826 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-652381f0-c0fd-449b-94f4-76aba0606841 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:59.242123 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-652381f0-c0fd-449b-94f4-76aba0606841 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1812 microversion: 2.20 time: 0.236126 Oct 28 09:51:59.242718 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 239/454] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:51:59 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1812 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:59.248125 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-5ba17a60-ec65-4417-aad5-f369db3cf445 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:59.254794 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5ba17a60-ec65-4417-aad5-f369db3cf445 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:59.255186 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5ba17a60-ec65-4417-aad5-f369db3cf445 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:59.258017 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-61412c67-3750-4a64-ae78-2faa46e21155 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:59.266835 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-61412c67-3750-4a64-ae78-2faa46e21155 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e" status: 200 len: 1318 microversion: 2.1 time: 0.215940 Oct 28 09:51:59.270305 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 216/455] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:59 2021] GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:59.279779 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-5ba17a60-ec65-4417-aad5-f369db3cf445 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Going to try to start instance {{(pid=123069) start /opt/stack/nova/nova/compute/api.py:2675}} Oct 28 09:51:59.479337 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-5ba17a60-ec65-4417-aad5-f369db3cf445 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action" status: 202 len: 0 microversion: 2.1 time: 0.234519 Oct 28 09:51:59.484186 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 240/456] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:51:59 2021] POST /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:51:59.488164 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-4fa96f4d-6af9-4264-b21a-82a75b690c1c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:59.488788 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-4fa96f4d-6af9-4264-b21a-82a75b690c1c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:59.495566 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4fa96f4d-6af9-4264-b21a-82a75b690c1c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:59.496012 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4fa96f4d-6af9-4264-b21a-82a75b690c1c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:59.496889 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4fa96f4d-6af9-4264-b21a-82a75b690c1c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:59.497328 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4fa96f4d-6af9-4264-b21a-82a75b690c1c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:59.624952 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-4fa96f4d-6af9-4264-b21a-82a75b690c1c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:59.633049 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-4fa96f4d-6af9-4264-b21a-82a75b690c1c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1667 microversion: 2.1 time: 0.147997 Oct 28 09:51:59.633711 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 217/457] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:59 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1667 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:51:59.988378 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-17ca2ee9-565d-4917-9117-e2070dfe360b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:59.989122 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-17ca2ee9-565d-4917-9117-e2070dfe360b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:51:59.996533 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-17ca2ee9-565d-4917-9117-e2070dfe360b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:59.996933 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-17ca2ee9-565d-4917-9117-e2070dfe360b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:51:59.997793 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-17ca2ee9-565d-4917-9117-e2070dfe360b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:51:59.998128 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-17ca2ee9-565d-4917-9117-e2070dfe360b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:00.126772 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-17ca2ee9-565d-4917-9117-e2070dfe360b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:00.135734 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-17ca2ee9-565d-4917-9117-e2070dfe360b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1263 microversion: 2.1 time: 0.151992 Oct 28 09:52:00.136788 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 241/458] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:51:59 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:00.261855 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-c2a88796-b150-4495-8a77-60f3b76c38f4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:00.262499 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-c2a88796-b150-4495-8a77-60f3b76c38f4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:00.269808 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c2a88796-b150-4495-8a77-60f3b76c38f4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:00.269808 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c2a88796-b150-4495-8a77-60f3b76c38f4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:00.270418 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c2a88796-b150-4495-8a77-60f3b76c38f4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:00.270852 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c2a88796-b150-4495-8a77-60f3b76c38f4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:00.285363 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-bb2cf478-14b7-44cf-867f-6f843338e96f tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:00.287545 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-bb2cf478-14b7-44cf-867f-6f843338e96f tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: 68f4383c-7f8e-4f49-9377-f11540e9f81e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:00.294181 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bb2cf478-14b7-44cf-867f-6f843338e96f tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:00.294621 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bb2cf478-14b7-44cf-867f-6f843338e96f tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:00.295420 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bb2cf478-14b7-44cf-867f-6f843338e96f tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:00.295909 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bb2cf478-14b7-44cf-867f-6f843338e96f tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:00.464415 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-c2a88796-b150-4495-8a77-60f3b76c38f4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:00.471909 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-bb2cf478-14b7-44cf-867f-6f843338e96f tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:00.473041 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-c2a88796-b150-4495-8a77-60f3b76c38f4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:00.474551 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-c2a88796-b150-4495-8a77-60f3b76c38f4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:00.475720 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-c2a88796-b150-4495-8a77-60f3b76c38f4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1812 microversion: 2.20 time: 0.217696 Oct 28 09:52:00.476281 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 218/459] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:52:00 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1812 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:52:00.479916 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-bb2cf478-14b7-44cf-867f-6f843338e96f tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e" status: 200 len: 1318 microversion: 2.1 time: 0.198763 Oct 28 09:52:00.480486 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 242/460] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:00 2021] GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:52:00.650741 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-73ccfe72-a0b2-4e45-8608-ec80be72331a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:00.651983 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-73ccfe72-a0b2-4e45-8608-ec80be72331a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:00.658649 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-73ccfe72-a0b2-4e45-8608-ec80be72331a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:00.659097 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-73ccfe72-a0b2-4e45-8608-ec80be72331a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:00.659874 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-73ccfe72-a0b2-4e45-8608-ec80be72331a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:00.660310 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-73ccfe72-a0b2-4e45-8608-ec80be72331a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:00.802984 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-73ccfe72-a0b2-4e45-8608-ec80be72331a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:00.811532 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-73ccfe72-a0b2-4e45-8608-ec80be72331a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1667 microversion: 2.1 time: 0.165233 Oct 28 09:52:00.812107 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 219/461] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:00 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1667 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:01.152742 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-9273740d-7aac-4940-99dc-ec42e5474b78 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:01.153313 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-9273740d-7aac-4940-99dc-ec42e5474b78 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:01.159781 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9273740d-7aac-4940-99dc-ec42e5474b78 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:01.160212 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9273740d-7aac-4940-99dc-ec42e5474b78 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:01.160990 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9273740d-7aac-4940-99dc-ec42e5474b78 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:01.161408 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9273740d-7aac-4940-99dc-ec42e5474b78 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:01.288047 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-9273740d-7aac-4940-99dc-ec42e5474b78 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:01.296072 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-9273740d-7aac-4940-99dc-ec42e5474b78 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1263 microversion: 2.1 time: 0.147450 Oct 28 09:52:01.296642 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 243/462] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:01 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1263 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:01.494251 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-f3d8d248-d970-4335-bc7f-04f200f95486 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:01.495950 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-f3d8d248-d970-4335-bc7f-04f200f95486 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:01.496286 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-e4f2d847-c2b7-4753-a0ff-60438d6f7a12 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:01.497093 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-e4f2d847-c2b7-4753-a0ff-60438d6f7a12 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: 68f4383c-7f8e-4f49-9377-f11540e9f81e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:01.501989 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f3d8d248-d970-4335-bc7f-04f200f95486 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:01.502719 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f3d8d248-d970-4335-bc7f-04f200f95486 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:01.502866 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e4f2d847-c2b7-4753-a0ff-60438d6f7a12 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:01.503246 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e4f2d847-c2b7-4753-a0ff-60438d6f7a12 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:01.503519 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f3d8d248-d970-4335-bc7f-04f200f95486 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:01.503952 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f3d8d248-d970-4335-bc7f-04f200f95486 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:01.504209 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e4f2d847-c2b7-4753-a0ff-60438d6f7a12 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:01.504635 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e4f2d847-c2b7-4753-a0ff-60438d6f7a12 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:01.701482 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-e4f2d847-c2b7-4753-a0ff-60438d6f7a12 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:01.706884 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-f3d8d248-d970-4335-bc7f-04f200f95486 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:01.709723 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-e4f2d847-c2b7-4753-a0ff-60438d6f7a12 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e" status: 200 len: 1502 microversion: 2.1 time: 0.216996 Oct 28 09:52:01.710468 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 244/463] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:01 2021] GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e => generated 1502 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:52:01.716432 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-f3d8d248-d970-4335-bc7f-04f200f95486 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:01.717945 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-f3d8d248-d970-4335-bc7f-04f200f95486 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:01.719088 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-f3d8d248-d970-4335-bc7f-04f200f95486 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1812 microversion: 2.20 time: 0.228909 Oct 28 09:52:01.719639 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 220/464] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:52:01 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1812 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:52:01.829643 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-a16b750b-f834-4eef-ab41-f749754dd31b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:01.830245 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-a16b750b-f834-4eef-ab41-f749754dd31b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:01.836567 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a16b750b-f834-4eef-ab41-f749754dd31b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:01.838881 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a16b750b-f834-4eef-ab41-f749754dd31b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:01.839056 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a16b750b-f834-4eef-ab41-f749754dd31b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:01.839395 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a16b750b-f834-4eef-ab41-f749754dd31b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:01.967801 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-a16b750b-f834-4eef-ab41-f749754dd31b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:01.975267 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-a16b750b-f834-4eef-ab41-f749754dd31b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1671 microversion: 2.1 time: 0.149235 Oct 28 09:52:01.976255 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 245/465] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:01 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1671 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:02.313673 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-455a9654-71b2-46e0-990c-3b37f8169454 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:02.314281 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-455a9654-71b2-46e0-990c-3b37f8169454 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:02.320339 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-455a9654-71b2-46e0-990c-3b37f8169454 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:02.320851 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-455a9654-71b2-46e0-990c-3b37f8169454 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:02.322561 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-455a9654-71b2-46e0-990c-3b37f8169454 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:02.323355 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-455a9654-71b2-46e0-990c-3b37f8169454 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:02.460247 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-455a9654-71b2-46e0-990c-3b37f8169454 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:02.465091 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-455a9654-71b2-46e0-990c-3b37f8169454 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1263 microversion: 2.1 time: 0.155241 Oct 28 09:52:02.477457 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 221/466] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:02 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1263 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:02.738588 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-c90a77ec-5cac-4b11-add3-d740ec4e5bb7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:02.739126 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-c90a77ec-5cac-4b11-add3-d740ec4e5bb7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:02.747435 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c90a77ec-5cac-4b11-add3-d740ec4e5bb7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:02.747873 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c90a77ec-5cac-4b11-add3-d740ec4e5bb7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:02.748637 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c90a77ec-5cac-4b11-add3-d740ec4e5bb7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:02.749085 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c90a77ec-5cac-4b11-add3-d740ec4e5bb7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:02.874258 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-c90a77ec-5cac-4b11-add3-d740ec4e5bb7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:02.883258 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-c90a77ec-5cac-4b11-add3-d740ec4e5bb7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:02.888475 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-c90a77ec-5cac-4b11-add3-d740ec4e5bb7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:02.888475 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-c90a77ec-5cac-4b11-add3-d740ec4e5bb7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1812 microversion: 2.20 time: 0.152491 Oct 28 09:52:02.888475 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 246/467] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:52:02 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1812 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:52:02.890141 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-370a8a5b-b409-4a94-a4ae-52797a9dbccb req-d5e08f76-e06b-4052-b6c5-e01f0a5d76d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a28831e5-4c0c-4dd9-bf92-ccf43a500b27", "name": "network-vif-plugged", "status": "completed", "tag": "94cbd2b9-09d8-4c85-ab69-0e95ad1404ee"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:02.891743 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:52:02.891743 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:52:02.899411 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-370a8a5b-b409-4a94-a4ae-52797a9dbccb req-d5e08f76-e06b-4052-b6c5-e01f0a5d76d4 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:02.900776 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-370a8a5b-b409-4a94-a4ae-52797a9dbccb req-d5e08f76-e06b-4052-b6c5-e01f0a5d76d4 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:02.912379 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-370a8a5b-b409-4a94-a4ae-52797a9dbccb req-d5e08f76-e06b-4052-b6c5-e01f0a5d76d4 service nova] Creating event network-vif-plugged:94cbd2b9-09d8-4c85-ab69-0e95ad1404ee for instance a28831e5-4c0c-4dd9-bf92-ccf43a500b27 on hv-cinder-81571 Oct 28 09:52:02.917449 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-370a8a5b-b409-4a94-a4ae-52797a9dbccb req-d5e08f76-e06b-4052-b6c5-e01f0a5d76d4 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032256 Oct 28 09:52:02.918073 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 222/468] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:52:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:03.141672 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-dadd4fe8-fe97-4d27-a4fe-74e8daf35beb tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:03.144810 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-dadd4fe8-fe97-4d27-a4fe-74e8daf35beb tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: 68f4383c-7f8e-4f49-9377-f11540e9f81e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:03.148099 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-dadd4fe8-fe97-4d27-a4fe-74e8daf35beb tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:03.148534 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-dadd4fe8-fe97-4d27-a4fe-74e8daf35beb tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:03.149399 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-dadd4fe8-fe97-4d27-a4fe-74e8daf35beb tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:03.149897 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-dadd4fe8-fe97-4d27-a4fe-74e8daf35beb tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:03.174047 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-dadd4fe8-fe97-4d27-a4fe-74e8daf35beb tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: 68f4383c-7f8e-4f49-9377-f11540e9f81e] Going to try to terminate instance {{(pid=123069) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 09:52:03.464380 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-dadd4fe8-fe97-4d27-a4fe-74e8daf35beb tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "DELETE /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e" status: 204 len: 0 microversion: 2.1 time: 0.326204 Oct 28 09:52:03.465084 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 247/469] 10.222.0.104 () {58 vars in 1243 bytes} [Thu Oct 28 09:52:03 2021] DELETE /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:52:03.473616 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-023674ab-3505-48b1-b414-15d3026149ff tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:03.474313 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-023674ab-3505-48b1-b414-15d3026149ff tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: 68f4383c-7f8e-4f49-9377-f11540e9f81e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:03.481258 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-023674ab-3505-48b1-b414-15d3026149ff tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:03.481705 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-023674ab-3505-48b1-b414-15d3026149ff tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:03.482479 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-023674ab-3505-48b1-b414-15d3026149ff tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:03.482914 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-023674ab-3505-48b1-b414-15d3026149ff tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:03.491801 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-1dae3921-3cef-480c-a026-24baf361e5ce tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:03.496510 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-1dae3921-3cef-480c-a026-24baf361e5ce tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:03.499122 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1dae3921-3cef-480c-a026-24baf361e5ce tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:03.499556 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1dae3921-3cef-480c-a026-24baf361e5ce tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:03.500314 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1dae3921-3cef-480c-a026-24baf361e5ce tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:03.500765 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1dae3921-3cef-480c-a026-24baf361e5ce tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:03.678119 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-023674ab-3505-48b1-b414-15d3026149ff tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:03.682079 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-1dae3921-3cef-480c-a026-24baf361e5ce tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:03.687131 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-023674ab-3505-48b1-b414-15d3026149ff tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e" status: 200 len: 1508 microversion: 2.1 time: 0.217487 Oct 28 09:52:03.687791 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 223/470] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:03 2021] GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e => generated 1508 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:03.693639 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-1dae3921-3cef-480c-a026-24baf361e5ce tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1263 microversion: 2.1 time: 0.205905 Oct 28 09:52:03.694188 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 248/471] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:03 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1263 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:52:03.908847 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-eb7ab84f-0717-447f-9603-266749bd5fb0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:03.909394 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-eb7ab84f-0717-447f-9603-266749bd5fb0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:03.916683 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-eb7ab84f-0717-447f-9603-266749bd5fb0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:03.917139 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-eb7ab84f-0717-447f-9603-266749bd5fb0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:03.917911 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-eb7ab84f-0717-447f-9603-266749bd5fb0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:03.918346 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-eb7ab84f-0717-447f-9603-266749bd5fb0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:04.042788 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-eb7ab84f-0717-447f-9603-266749bd5fb0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:04.051510 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-eb7ab84f-0717-447f-9603-266749bd5fb0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:04.056862 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-eb7ab84f-0717-447f-9603-266749bd5fb0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:04.056862 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-eb7ab84f-0717-447f-9603-266749bd5fb0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1812 microversion: 2.20 time: 0.149330 Oct 28 09:52:04.056862 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 224/472] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:52:03 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1812 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:52:04.704556 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-810f651b-ef20-4e88-9a74-5ade6a84cbd4 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:04.705219 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-810f651b-ef20-4e88-9a74-5ade6a84cbd4 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: 68f4383c-7f8e-4f49-9377-f11540e9f81e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:04.710908 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-cf1cab53-d9da-489d-9681-5f5e9b948ead tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:04.711508 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-cf1cab53-d9da-489d-9681-5f5e9b948ead tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:04.711765 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-810f651b-ef20-4e88-9a74-5ade6a84cbd4 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:04.712330 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-810f651b-ef20-4e88-9a74-5ade6a84cbd4 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:04.713216 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-810f651b-ef20-4e88-9a74-5ade6a84cbd4 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:04.713641 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-810f651b-ef20-4e88-9a74-5ade6a84cbd4 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:04.717865 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cf1cab53-d9da-489d-9681-5f5e9b948ead tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:04.718304 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cf1cab53-d9da-489d-9681-5f5e9b948ead tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:04.719075 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cf1cab53-d9da-489d-9681-5f5e9b948ead tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:04.719496 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cf1cab53-d9da-489d-9681-5f5e9b948ead tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:04.902741 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-810f651b-ef20-4e88-9a74-5ade6a84cbd4 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:04.910991 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-810f651b-ef20-4e88-9a74-5ade6a84cbd4 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e" status: 200 len: 1508 microversion: 2.1 time: 0.210006 Oct 28 09:52:04.911580 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 249/473] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:04 2021] GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e => generated 1508 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:04.912592 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-cf1cab53-d9da-489d-9681-5f5e9b948ead tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:04.921711 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-cf1cab53-d9da-489d-9681-5f5e9b948ead tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1263 microversion: 2.1 time: 0.214620 Oct 28 09:52:04.922294 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 225/474] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:04 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1263 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:52:05.073206 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-228d7dad-ddc0-4f28-92dd-ab2741395704 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:05.073861 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-228d7dad-ddc0-4f28-92dd-ab2741395704 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:05.079734 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-228d7dad-ddc0-4f28-92dd-ab2741395704 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:05.080099 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-228d7dad-ddc0-4f28-92dd-ab2741395704 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:05.080893 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-228d7dad-ddc0-4f28-92dd-ab2741395704 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:05.081317 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-228d7dad-ddc0-4f28-92dd-ab2741395704 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:05.208077 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-228d7dad-ddc0-4f28-92dd-ab2741395704 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:05.219413 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-228d7dad-ddc0-4f28-92dd-ab2741395704 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:05.221410 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-228d7dad-ddc0-4f28-92dd-ab2741395704 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:05.222499 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-228d7dad-ddc0-4f28-92dd-ab2741395704 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1812 microversion: 2.20 time: 0.153200 Oct 28 09:52:05.223067 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 250/475] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:52:05 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1812 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:52:05.929531 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-38f2a7db-d336-47e0-8991-d89c3d409bbd tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:05.930211 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-38f2a7db-d336-47e0-8991-d89c3d409bbd tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: 68f4383c-7f8e-4f49-9377-f11540e9f81e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:05.937478 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-38f2a7db-d336-47e0-8991-d89c3d409bbd tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:05.937905 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-38f2a7db-d336-47e0-8991-d89c3d409bbd tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:05.938699 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-38f2a7db-d336-47e0-8991-d89c3d409bbd tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:05.939129 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-38f2a7db-d336-47e0-8991-d89c3d409bbd tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:05.944298 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-bfa07f83-e86c-4eda-ad48-d04d7c3f1b0d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:05.944987 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-bfa07f83-e86c-4eda-ad48-d04d7c3f1b0d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:05.951751 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bfa07f83-e86c-4eda-ad48-d04d7c3f1b0d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:05.952190 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bfa07f83-e86c-4eda-ad48-d04d7c3f1b0d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:05.952988 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bfa07f83-e86c-4eda-ad48-d04d7c3f1b0d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:05.953412 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bfa07f83-e86c-4eda-ad48-d04d7c3f1b0d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:06.131283 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-38f2a7db-d336-47e0-8991-d89c3d409bbd tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:06.139692 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-38f2a7db-d336-47e0-8991-d89c3d409bbd tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e" status: 200 len: 1508 microversion: 2.1 time: 0.213807 Oct 28 09:52:06.140279 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 226/476] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:05 2021] GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e => generated 1508 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:06.142329 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-bfa07f83-e86c-4eda-ad48-d04d7c3f1b0d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:06.150582 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-bfa07f83-e86c-4eda-ad48-d04d7c3f1b0d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1263 microversion: 2.1 time: 0.210685 Oct 28 09:52:06.151153 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 251/477] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:05 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1263 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:52:06.241491 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-510a9117-7b37-49ed-a098-038a8acc88ce tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:06.242014 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-510a9117-7b37-49ed-a098-038a8acc88ce tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:06.248585 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-510a9117-7b37-49ed-a098-038a8acc88ce tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:06.249055 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-510a9117-7b37-49ed-a098-038a8acc88ce tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:06.249823 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-510a9117-7b37-49ed-a098-038a8acc88ce tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:06.250249 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-510a9117-7b37-49ed-a098-038a8acc88ce tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:06.372793 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-510a9117-7b37-49ed-a098-038a8acc88ce tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:06.381116 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-510a9117-7b37-49ed-a098-038a8acc88ce tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:06.382889 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-510a9117-7b37-49ed-a098-038a8acc88ce tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:06.384396 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-510a9117-7b37-49ed-a098-038a8acc88ce tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1812 microversion: 2.20 time: 0.146443 Oct 28 09:52:06.385157 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 227/478] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:52:06 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1812 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:52:07.157260 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-570bc818-b430-46ae-8b26-6cba1ce0f3cc tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:07.157795 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-570bc818-b430-46ae-8b26-6cba1ce0f3cc tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: 68f4383c-7f8e-4f49-9377-f11540e9f81e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:07.164401 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-570bc818-b430-46ae-8b26-6cba1ce0f3cc tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:07.164905 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-570bc818-b430-46ae-8b26-6cba1ce0f3cc tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:07.165744 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-570bc818-b430-46ae-8b26-6cba1ce0f3cc tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:07.166166 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-570bc818-b430-46ae-8b26-6cba1ce0f3cc tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:07.167224 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-41664788-36b7-49db-83c2-4cd8851e983b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:07.167832 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-41664788-36b7-49db-83c2-4cd8851e983b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:07.174378 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-41664788-36b7-49db-83c2-4cd8851e983b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:07.174820 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-41664788-36b7-49db-83c2-4cd8851e983b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:07.175596 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-41664788-36b7-49db-83c2-4cd8851e983b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:07.176020 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-41664788-36b7-49db-83c2-4cd8851e983b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:07.348086 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-570bc818-b430-46ae-8b26-6cba1ce0f3cc tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:07.356207 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-570bc818-b430-46ae-8b26-6cba1ce0f3cc tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e" status: 200 len: 1508 microversion: 2.1 time: 0.202581 Oct 28 09:52:07.356590 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-41664788-36b7-49db-83c2-4cd8851e983b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:07.356940 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 252/479] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:07 2021] GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e => generated 1508 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:07.364114 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-41664788-36b7-49db-83c2-4cd8851e983b tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1263 microversion: 2.1 time: 0.200486 Oct 28 09:52:07.364718 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 228/480] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:07 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1263 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:52:07.403426 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-3551810b-5934-4869-84ee-7522b50d4e0e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:07.404028 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-3551810b-5934-4869-84ee-7522b50d4e0e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:07.410043 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3551810b-5934-4869-84ee-7522b50d4e0e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:07.410425 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3551810b-5934-4869-84ee-7522b50d4e0e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:07.411184 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3551810b-5934-4869-84ee-7522b50d4e0e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:07.411612 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3551810b-5934-4869-84ee-7522b50d4e0e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:07.542477 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-3551810b-5934-4869-84ee-7522b50d4e0e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:07.551471 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-3551810b-5934-4869-84ee-7522b50d4e0e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:07.553086 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-3551810b-5934-4869-84ee-7522b50d4e0e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:07.554255 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-3551810b-5934-4869-84ee-7522b50d4e0e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1812 microversion: 2.20 time: 0.155540 Oct 28 09:52:07.555022 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 253/481] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:52:07 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1812 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:52:08.387193 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-bb9b753d-be36-4369-b4e1-025f3a70b56c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:08.388833 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-bb9b753d-be36-4369-b4e1-025f3a70b56c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: 68f4383c-7f8e-4f49-9377-f11540e9f81e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:08.396982 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-788bcba8-c83c-4de0-8612-5b4693fdd764 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:08.397960 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-788bcba8-c83c-4de0-8612-5b4693fdd764 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:08.406037 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-788bcba8-c83c-4de0-8612-5b4693fdd764 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:08.406616 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-788bcba8-c83c-4de0-8612-5b4693fdd764 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:08.407519 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-788bcba8-c83c-4de0-8612-5b4693fdd764 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:08.408109 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-788bcba8-c83c-4de0-8612-5b4693fdd764 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:08.409048 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bb9b753d-be36-4369-b4e1-025f3a70b56c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:08.409511 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bb9b753d-be36-4369-b4e1-025f3a70b56c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:08.410324 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bb9b753d-be36-4369-b4e1-025f3a70b56c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:08.410756 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bb9b753d-be36-4369-b4e1-025f3a70b56c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:08.607882 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-788bcba8-c83c-4de0-8612-5b4693fdd764 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:08.614277 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-bb9b753d-be36-4369-b4e1-025f3a70b56c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:08.616019 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-788bcba8-c83c-4de0-8612-5b4693fdd764 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1263 microversion: 2.1 time: 0.237066 Oct 28 09:52:08.616595 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 254/482] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:08 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1263 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:08.621549 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-e85b8771-8284-498d-92e1-e2f7b3fd747b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:08.622379 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-e85b8771-8284-498d-92e1-e2f7b3fd747b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:08.624002 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-bb9b753d-be36-4369-b4e1-025f3a70b56c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e" status: 200 len: 1508 microversion: 2.1 time: 0.243304 Oct 28 09:52:08.624987 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 229/483] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:08 2021] GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e => generated 1508 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:08.628546 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e85b8771-8284-498d-92e1-e2f7b3fd747b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:08.629022 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e85b8771-8284-498d-92e1-e2f7b3fd747b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:08.629789 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e85b8771-8284-498d-92e1-e2f7b3fd747b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:08.630213 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e85b8771-8284-498d-92e1-e2f7b3fd747b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:08.991448 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-e85b8771-8284-498d-92e1-e2f7b3fd747b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:09.000783 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-e85b8771-8284-498d-92e1-e2f7b3fd747b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:09.002274 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-e85b8771-8284-498d-92e1-e2f7b3fd747b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:09.003842 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-e85b8771-8284-498d-92e1-e2f7b3fd747b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1812 microversion: 2.20 time: 0.386092 Oct 28 09:52:09.004412 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 255/484] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:52:08 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1812 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:52:09.349358 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-98a8fae9-1966-479a-a943-fb6e0afc1fb1 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:09.349970 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-98a8fae9-1966-479a-a943-fb6e0afc1fb1 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:09.357851 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-98a8fae9-1966-479a-a943-fb6e0afc1fb1 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:09.358328 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-98a8fae9-1966-479a-a943-fb6e0afc1fb1 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:09.359298 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-98a8fae9-1966-479a-a943-fb6e0afc1fb1 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:09.359728 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-98a8fae9-1966-479a-a943-fb6e0afc1fb1 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:09.496396 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-98a8fae9-1966-479a-a943-fb6e0afc1fb1 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:09.504310 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-98a8fae9-1966-479a-a943-fb6e0afc1fb1 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1598 microversion: 2.1 time: 0.159337 Oct 28 09:52:09.504926 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 230/485] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:09 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1598 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:09.634000 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-abf146d5-33f6-4ead-bb50-d546b971542d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:09.634585 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-abf146d5-33f6-4ead-bb50-d546b971542d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:09.641111 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-abf146d5-33f6-4ead-bb50-d546b971542d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:09.641553 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-abf146d5-33f6-4ead-bb50-d546b971542d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:09.642329 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-abf146d5-33f6-4ead-bb50-d546b971542d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:09.642752 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-abf146d5-33f6-4ead-bb50-d546b971542d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:09.643776 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-43c3a52a-cefb-41a0-8e5e-aaa60f5615df tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:09.644400 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-43c3a52a-cefb-41a0-8e5e-aaa60f5615df tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: 68f4383c-7f8e-4f49-9377-f11540e9f81e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:09.650414 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-43c3a52a-cefb-41a0-8e5e-aaa60f5615df tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:09.651085 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-43c3a52a-cefb-41a0-8e5e-aaa60f5615df tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:09.651914 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-43c3a52a-cefb-41a0-8e5e-aaa60f5615df tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:09.652348 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-43c3a52a-cefb-41a0-8e5e-aaa60f5615df tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:09.848512 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-43c3a52a-cefb-41a0-8e5e-aaa60f5615df tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:09.851861 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-abf146d5-33f6-4ead-bb50-d546b971542d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:09.861462 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-abf146d5-33f6-4ead-bb50-d546b971542d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1447 microversion: 2.1 time: 0.231208 Oct 28 09:52:09.862205 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-43c3a52a-cefb-41a0-8e5e-aaa60f5615df tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e" status: 200 len: 1508 microversion: 2.1 time: 0.222392 Oct 28 09:52:09.862486 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 256/486] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:09 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1447 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:09.862987 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 231/487] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:09 2021] GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e => generated 1508 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:09.879055 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-7b8de094-706c-414b-a49e-37d0a067ff9f tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:09.879966 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-7b8de094-706c-414b-a49e-37d0a067ff9f tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:09.886747 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7b8de094-706c-414b-a49e-37d0a067ff9f tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:09.887182 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7b8de094-706c-414b-a49e-37d0a067ff9f tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:09.887966 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7b8de094-706c-414b-a49e-37d0a067ff9f tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:09.888439 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7b8de094-706c-414b-a49e-37d0a067ff9f tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:10.026710 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-e66bde57-f27b-4141-a550-279085a43561 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:10.027748 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-e66bde57-f27b-4141-a550-279085a43561 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:10.031665 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-7b8de094-706c-414b-a49e-37d0a067ff9f tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:10.035270 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e66bde57-f27b-4141-a550-279085a43561 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:10.035976 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e66bde57-f27b-4141-a550-279085a43561 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:10.037089 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e66bde57-f27b-4141-a550-279085a43561 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:10.037794 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e66bde57-f27b-4141-a550-279085a43561 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:10.043279 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-7b8de094-706c-414b-a49e-37d0a067ff9f tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1447 microversion: 2.1 time: 0.168088 Oct 28 09:52:10.044227 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 257/488] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:09 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1447 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:52:10.217277 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-e66bde57-f27b-4141-a550-279085a43561 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:10.236357 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-e66bde57-f27b-4141-a550-279085a43561 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:10.246748 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-e66bde57-f27b-4141-a550-279085a43561 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:10.262221 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-e66bde57-f27b-4141-a550-279085a43561 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1812 microversion: 2.20 time: 0.240563 Oct 28 09:52:10.267566 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 232/489] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:52:10 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1812 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:52:10.648319 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [req-5ee3900f-46ba-434c-92ee-b1a9693858e6 req-d7540366-912d-40bc-81f0-9527c507daf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f4383c-7f8e-4f49-9377-f11540e9f81e", "name": "network-vif-deleted", "tag": "b9d6f69f-6582-4e12-8137-5f6aa83f2874"}]} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:10.651350 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:52:10.651350 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 09:52:10.669796 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-5ee3900f-46ba-434c-92ee-b1a9693858e6 req-d7540366-912d-40bc-81f0-9527c507daf3 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:10.671086 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-5ee3900f-46ba-434c-92ee-b1a9693858e6 req-d7540366-912d-40bc-81f0-9527c507daf3 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:10.682627 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.compute.server_external_events [req-5ee3900f-46ba-434c-92ee-b1a9693858e6 req-d7540366-912d-40bc-81f0-9527c507daf3 service nova] Creating event network-vif-deleted:b9d6f69f-6582-4e12-8137-5f6aa83f2874 for instance 68f4383c-7f8e-4f49-9377-f11540e9f81e on hv-cinder-81571 Oct 28 09:52:10.688032 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [req-5ee3900f-46ba-434c-92ee-b1a9693858e6 req-d7540366-912d-40bc-81f0-9527c507daf3 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043241 Oct 28 09:52:10.688624 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 258/490] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:52:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:10.883785 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-e18980e1-7e15-4c6a-9477-d7cb15a61e77 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:10.886452 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-e18980e1-7e15-4c6a-9477-d7cb15a61e77 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: 68f4383c-7f8e-4f49-9377-f11540e9f81e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:10.896602 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e18980e1-7e15-4c6a-9477-d7cb15a61e77 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:10.902280 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e18980e1-7e15-4c6a-9477-d7cb15a61e77 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:10.903965 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e18980e1-7e15-4c6a-9477-d7cb15a61e77 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:10.904571 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e18980e1-7e15-4c6a-9477-d7cb15a61e77 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:11.074150 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-e18980e1-7e15-4c6a-9477-d7cb15a61e77 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:11.086887 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-e18980e1-7e15-4c6a-9477-d7cb15a61e77 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e" status: 200 len: 1303 microversion: 2.1 time: 0.208063 Oct 28 09:52:11.098144 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 233/491] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:10 2021] GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e => generated 1303 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:11.288021 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-a0e77cdd-33c0-4628-b157-cc536431807e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:11.289081 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-a0e77cdd-33c0-4628-b157-cc536431807e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:11.296638 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a0e77cdd-33c0-4628-b157-cc536431807e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:11.297497 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a0e77cdd-33c0-4628-b157-cc536431807e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:11.298061 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a0e77cdd-33c0-4628-b157-cc536431807e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:11.298680 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a0e77cdd-33c0-4628-b157-cc536431807e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:11.473613 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-a0e77cdd-33c0-4628-b157-cc536431807e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:11.488058 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-a0e77cdd-33c0-4628-b157-cc536431807e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:11.490225 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-a0e77cdd-33c0-4628-b157-cc536431807e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:11.491810 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-a0e77cdd-33c0-4628-b157-cc536431807e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1812 microversion: 2.20 time: 0.207963 Oct 28 09:52:11.492962 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 259/492] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:52:11 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1812 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:52:12.111668 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-68036df3-480a-4808-b90b-bf27c90ac31f tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:12.113644 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-68036df3-480a-4808-b90b-bf27c90ac31f tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: 68f4383c-7f8e-4f49-9377-f11540e9f81e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:12.126322 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-68036df3-480a-4808-b90b-bf27c90ac31f tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:12.126322 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-68036df3-480a-4808-b90b-bf27c90ac31f tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:12.126322 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-68036df3-480a-4808-b90b-bf27c90ac31f tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:12.126322 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-68036df3-480a-4808-b90b-bf27c90ac31f tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:12.164406 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-68036df3-480a-4808-b90b-bf27c90ac31f tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:12.164890 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-68036df3-480a-4808-b90b-bf27c90ac31f tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:12.165477 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.objects.instance [None req-68036df3-480a-4808-b90b-bf27c90ac31f tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lazy-loading 'fault' on Instance uuid 68f4383c-7f8e-4f49-9377-f11540e9f81e {{(pid=123068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 09:52:12.216907 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-68036df3-480a-4808-b90b-bf27c90ac31f tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:12.228080 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-68036df3-480a-4808-b90b-bf27c90ac31f tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e" status: 200 len: 1308 microversion: 2.1 time: 0.119989 Oct 28 09:52:12.230059 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 234/493] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:12 2021] GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e => generated 1308 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:12.512568 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-870fe4cd-1c6f-4e47-97d2-10f4e8423e76 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:12.513432 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-870fe4cd-1c6f-4e47-97d2-10f4e8423e76 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:12.523041 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-870fe4cd-1c6f-4e47-97d2-10f4e8423e76 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:12.523915 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-870fe4cd-1c6f-4e47-97d2-10f4e8423e76 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:12.525674 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-870fe4cd-1c6f-4e47-97d2-10f4e8423e76 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:12.526472 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-870fe4cd-1c6f-4e47-97d2-10f4e8423e76 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:12.796720 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-870fe4cd-1c6f-4e47-97d2-10f4e8423e76 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:12.811378 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-870fe4cd-1c6f-4e47-97d2-10f4e8423e76 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:12.814993 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-870fe4cd-1c6f-4e47-97d2-10f4e8423e76 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:12.817543 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-870fe4cd-1c6f-4e47-97d2-10f4e8423e76 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1812 microversion: 2.20 time: 0.309301 Oct 28 09:52:12.819273 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 260/494] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:52:12 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1812 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:52:12.981672 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-751eed02-2f80-4634-beeb-440aebae4bc3 req-5d6f1fcd-7675-4002-b452-aaa3a75526f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b49b31e1-36d8-4096-a5fc-b2d46ef922eb", "name": "network-vif-plugged", "status": "completed", "tag": "b51e7b00-09ad-41ca-b851-00805473b75a"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:12.985721 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:52:12.985721 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:52:12.993082 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-751eed02-2f80-4634-beeb-440aebae4bc3 req-5d6f1fcd-7675-4002-b452-aaa3a75526f4 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:12.993689 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-751eed02-2f80-4634-beeb-440aebae4bc3 req-5d6f1fcd-7675-4002-b452-aaa3a75526f4 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:13.006286 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-751eed02-2f80-4634-beeb-440aebae4bc3 req-5d6f1fcd-7675-4002-b452-aaa3a75526f4 service nova] Creating event network-vif-plugged:b51e7b00-09ad-41ca-b851-00805473b75a for instance b49b31e1-36d8-4096-a5fc-b2d46ef922eb on hv-cinder-81571 Oct 28 09:52:13.012922 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-751eed02-2f80-4634-beeb-440aebae4bc3 req-5d6f1fcd-7675-4002-b452-aaa3a75526f4 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041365 Oct 28 09:52:13.014091 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 235/495] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:52:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:13.176816 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [req-1405be34-6e30-40a6-834b-f5a357188ddc req-cc96c990-2800-4bb6-9331-7a7c4ed6de50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d623582-8352-4294-9aca-086539f32232", "tag": "cbe862a5-40a7-43ef-b2b3-73aad1487228"}]} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:13.178587 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:52:13.178587 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 09:52:13.189317 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-1405be34-6e30-40a6-834b-f5a357188ddc req-cc96c990-2800-4bb6-9331-7a7c4ed6de50 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:13.190345 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-1405be34-6e30-40a6-834b-f5a357188ddc req-cc96c990-2800-4bb6-9331-7a7c4ed6de50 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:13.222948 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.compute.server_external_events [req-1405be34-6e30-40a6-834b-f5a357188ddc req-cc96c990-2800-4bb6-9331-7a7c4ed6de50 service nova] Creating event network-changed:cbe862a5-40a7-43ef-b2b3-73aad1487228 for instance 2d623582-8352-4294-9aca-086539f32232 on hv-cinder-81571 Oct 28 09:52:13.232719 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [req-1405be34-6e30-40a6-834b-f5a357188ddc req-cc96c990-2800-4bb6-9331-7a7c4ed6de50 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059164 Oct 28 09:52:13.234469 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 261/496] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:52:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:13.250142 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-fc845c07-3ebd-4de2-a2e0-f434ca47fb9d tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:13.252158 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-fc845c07-3ebd-4de2-a2e0-f434ca47fb9d tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: 68f4383c-7f8e-4f49-9377-f11540e9f81e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:13.263906 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fc845c07-3ebd-4de2-a2e0-f434ca47fb9d tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:13.264750 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fc845c07-3ebd-4de2-a2e0-f434ca47fb9d tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:13.265907 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fc845c07-3ebd-4de2-a2e0-f434ca47fb9d tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:13.266368 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fc845c07-3ebd-4de2-a2e0-f434ca47fb9d tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:13.288830 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.wsgi [None req-fc845c07-3ebd-4de2-a2e0-f434ca47fb9d tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] HTTP exception thrown: Instance 68f4383c-7f8e-4f49-9377-f11540e9f81e could not be found. Oct 28 09:52:13.289818 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-fc845c07-3ebd-4de2-a2e0-f434ca47fb9d tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Returning 404 to user: Instance 68f4383c-7f8e-4f49-9377-f11540e9f81e could not be found. {{(pid=123068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:52:13.290966 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-fc845c07-3ebd-4de2-a2e0-f434ca47fb9d tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e" status: 404 len: 111 microversion: 2.1 time: 0.048890 Oct 28 09:52:13.292144 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 236/497] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:13 2021] GET /compute/v2.1/servers/68f4383c-7f8e-4f49-9377-f11540e9f81e => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 09:52:13.485436 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-dbb7cd88-02a2-4ac8-a12d-5f47d2b8dd60 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-648334389", "imageRef": "623b30fc-1d92-46d9-b556-b9b963f3d76c", "flavorRef": "452", "networks": [{"uuid": "6e0d2282-0092-43e0-98c8-b68cec136250"}]}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:13.648328 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.network.neutron [None req-dbb7cd88-02a2-4ac8-a12d-5f47d2b8dd60 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] validate_networks() for [('6e0d2282-0092-43e0-98c8-b68cec136250', None, None, None, None, None)] {{(pid=123069) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 09:52:13.839414 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-b25d5454-e491-4abf-9823-a22a9addc1c3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:13.840581 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-b25d5454-e491-4abf-9823-a22a9addc1c3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:13.849333 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b25d5454-e491-4abf-9823-a22a9addc1c3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:13.850164 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b25d5454-e491-4abf-9823-a22a9addc1c3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:13.851469 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b25d5454-e491-4abf-9823-a22a9addc1c3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:13.852099 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b25d5454-e491-4abf-9823-a22a9addc1c3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:14.543237 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-b25d5454-e491-4abf-9823-a22a9addc1c3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:14.563971 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-b25d5454-e491-4abf-9823-a22a9addc1c3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:14.570002 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-b25d5454-e491-4abf-9823-a22a9addc1c3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:14.574608 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-b25d5454-e491-4abf-9823-a22a9addc1c3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1812 microversion: 2.20 time: 0.740550 Oct 28 09:52:14.592109 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 237/498] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:52:13 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1812 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:52:14.625090 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-b67f426b-eb96-43dd-bdd6-10a4c87de254 req-084cd01b-7298-4369-91b5-75cc48a6e730 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a28831e5-4c0c-4dd9-bf92-ccf43a500b27", "tag": "94cbd2b9-09d8-4c85-ab69-0e95ad1404ee"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:14.626953 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:52:14.626953 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:52:14.645525 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-b67f426b-eb96-43dd-bdd6-10a4c87de254 req-084cd01b-7298-4369-91b5-75cc48a6e730 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:14.646393 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-b67f426b-eb96-43dd-bdd6-10a4c87de254 req-084cd01b-7298-4369-91b5-75cc48a6e730 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:14.672607 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-b67f426b-eb96-43dd-bdd6-10a4c87de254 req-084cd01b-7298-4369-91b5-75cc48a6e730 service nova] Creating event network-changed:94cbd2b9-09d8-4c85-ab69-0e95ad1404ee for instance a28831e5-4c0c-4dd9-bf92-ccf43a500b27 on hv-cinder-81571 Oct 28 09:52:14.684107 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-b67f426b-eb96-43dd-bdd6-10a4c87de254 req-084cd01b-7298-4369-91b5-75cc48a6e730 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063658 Oct 28 09:52:14.685225 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 238/499] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:52:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:14.755359 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-dbb7cd88-02a2-4ac8-a12d-5f47d2b8dd60 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Flavor limits 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:52:14.756038 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-dbb7cd88-02a2-4ac8-a12d-5f47d2b8dd60 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Image limits 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:52:14.756472 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-dbb7cd88-02a2-4ac8-a12d-5f47d2b8dd60 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Flavor pref 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:52:14.757338 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-dbb7cd88-02a2-4ac8-a12d-5f47d2b8dd60 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Image pref 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:52:14.757824 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-dbb7cd88-02a2-4ac8-a12d-5f47d2b8dd60 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:52:14.770236 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-dbb7cd88-02a2-4ac8-a12d-5f47d2b8dd60 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:14.773099 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-dbb7cd88-02a2-4ac8-a12d-5f47d2b8dd60 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:14.773099 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-dbb7cd88-02a2-4ac8-a12d-5f47d2b8dd60 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:14.773099 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-dbb7cd88-02a2-4ac8-a12d-5f47d2b8dd60 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:14.790917 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.quota [None req-dbb7cd88-02a2-4ac8-a12d-5f47d2b8dd60 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Getting quotas for project d487a772480347a0b31aebb5f8cf6b7a. Resources: {'ram', 'cores', 'instances'} {{(pid=123069) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 09:52:14.797720 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.quota [None req-dbb7cd88-02a2-4ac8-a12d-5f47d2b8dd60 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Getting quotas for user 8e13e30490a54220ad0df4feee2ffcb2 and project d487a772480347a0b31aebb5f8cf6b7a. Resources: {'ram', 'cores', 'instances'} {{(pid=123069) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 09:52:14.809868 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-dbb7cd88-02a2-4ac8-a12d-5f47d2b8dd60 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Going to run 1 instances... {{(pid=123069) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 09:52:14.812628 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-dbb7cd88-02a2-4ac8-a12d-5f47d2b8dd60 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: b30699c5-d498-474f-a5eb-74b20b81e5ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='623b30fc-1d92-46d9-b556-b9b963f3d76c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 09:52:14.978287 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-dbb7cd88-02a2-4ac8-a12d-5f47d2b8dd60 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.506546 Oct 28 09:52:14.979659 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 262/500] 10.222.0.104 () {60 vars in 1151 bytes} [Thu Oct 28 09:52:13 2021] POST /compute/v2.1/servers => generated 382 bytes in 1521 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 28 09:52:14.989629 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-11f1772e-0643-410e-9daa-79847743c694 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:14.990658 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-11f1772e-0643-410e-9daa-79847743c694 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: b30699c5-d498-474f-a5eb-74b20b81e5ca] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:15.100875 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-11f1772e-0643-410e-9daa-79847743c694 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:15.109339 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-11f1772e-0643-410e-9daa-79847743c694 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca" status: 200 len: 1217 microversion: 2.1 time: 0.123512 Oct 28 09:52:15.110669 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 239/501] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:14 2021] GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca => generated 1217 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:15.597603 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-7933c01f-8109-47d9-946d-6c21602d1d12 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:15.598290 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-7933c01f-8109-47d9-946d-6c21602d1d12 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:15.608334 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7933c01f-8109-47d9-946d-6c21602d1d12 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:15.608865 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7933c01f-8109-47d9-946d-6c21602d1d12 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:15.609646 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7933c01f-8109-47d9-946d-6c21602d1d12 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:15.610309 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7933c01f-8109-47d9-946d-6c21602d1d12 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:15.791767 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-7933c01f-8109-47d9-946d-6c21602d1d12 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:15.806230 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-7933c01f-8109-47d9-946d-6c21602d1d12 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:15.808175 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-7933c01f-8109-47d9-946d-6c21602d1d12 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:15.809471 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-7933c01f-8109-47d9-946d-6c21602d1d12 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1812 microversion: 2.20 time: 0.216155 Oct 28 09:52:15.810883 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 263/502] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:52:15 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1812 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:52:16.127700 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-305744c9-d0f5-4082-a4d7-a5ca0a3c0231 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:16.128304 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-305744c9-d0f5-4082-a4d7-a5ca0a3c0231 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: b30699c5-d498-474f-a5eb-74b20b81e5ca] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:16.135994 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-305744c9-d0f5-4082-a4d7-a5ca0a3c0231 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:16.136446 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-305744c9-d0f5-4082-a4d7-a5ca0a3c0231 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:16.137274 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-305744c9-d0f5-4082-a4d7-a5ca0a3c0231 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:16.137714 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-305744c9-d0f5-4082-a4d7-a5ca0a3c0231 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:16.199611 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-305744c9-d0f5-4082-a4d7-a5ca0a3c0231 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:16.206656 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-305744c9-d0f5-4082-a4d7-a5ca0a3c0231 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca" status: 200 len: 1221 microversion: 2.1 time: 0.083091 Oct 28 09:52:16.207225 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 240/503] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:16 2021] GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca => generated 1221 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:16.831716 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-d74fefab-5df3-4b27-937b-dc8656fb2108 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:16.832831 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-d74fefab-5df3-4b27-937b-dc8656fb2108 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:16.841091 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d74fefab-5df3-4b27-937b-dc8656fb2108 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:16.841572 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d74fefab-5df3-4b27-937b-dc8656fb2108 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:16.842584 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d74fefab-5df3-4b27-937b-dc8656fb2108 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:16.843186 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d74fefab-5df3-4b27-937b-dc8656fb2108 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:16.945600 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-b4352d53-21f1-4a46-994d-f11a81d4fd7c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:16.952074 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-b4352d53-21f1-4a46-994d-f11a81d4fd7c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:16.965535 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b4352d53-21f1-4a46-994d-f11a81d4fd7c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:16.966349 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b4352d53-21f1-4a46-994d-f11a81d4fd7c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:16.967430 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b4352d53-21f1-4a46-994d-f11a81d4fd7c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:16.968229 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b4352d53-21f1-4a46-994d-f11a81d4fd7c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:17.019409 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-d74fefab-5df3-4b27-937b-dc8656fb2108 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:17.021737 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.objects.instance [None req-b4352d53-21f1-4a46-994d-f11a81d4fd7c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lazy-loading 'flavor' on Instance uuid 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f {{(pid=123068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 09:52:17.042294 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-d74fefab-5df3-4b27-937b-dc8656fb2108 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:17.042294 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-d74fefab-5df3-4b27-937b-dc8656fb2108 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:17.042294 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-d74fefab-5df3-4b27-937b-dc8656fb2108 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1812 microversion: 2.20 time: 0.211378 Oct 28 09:52:17.050573 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 264/504] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:52:16 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1812 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:52:17.224482 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-517ab910-5d5b-4eec-8d51-705264425e33 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:17.225420 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-517ab910-5d5b-4eec-8d51-705264425e33 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: b30699c5-d498-474f-a5eb-74b20b81e5ca] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:17.233236 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-517ab910-5d5b-4eec-8d51-705264425e33 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:17.233845 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-517ab910-5d5b-4eec-8d51-705264425e33 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:17.234898 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-517ab910-5d5b-4eec-8d51-705264425e33 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:17.235858 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-517ab910-5d5b-4eec-8d51-705264425e33 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:17.305534 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-517ab910-5d5b-4eec-8d51-705264425e33 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:17.313931 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-517ab910-5d5b-4eec-8d51-705264425e33 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca" status: 200 len: 1269 microversion: 2.1 time: 0.093105 Oct 28 09:52:17.314793 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 265/505] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:17 2021] GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca => generated 1269 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:17.599497 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-a6528ced-650a-48bc-8b32-944b1284c937 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1944720348"}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:17.600022 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-a6528ced-650a-48bc-8b32-944b1284c937 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:17.605787 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-b4352d53-21f1-4a46-994d-f11a81d4fd7c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "POST /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f/action" status: 200 len: 32 microversion: 2.1 time: 0.664071 Oct 28 09:52:17.606896 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 241/506] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:52:16 2021] POST /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f/action => generated 32 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:52:17.611249 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a6528ced-650a-48bc-8b32-944b1284c937 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:17.611693 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a6528ced-650a-48bc-8b32-944b1284c937 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:17.612497 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a6528ced-650a-48bc-8b32-944b1284c937 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:17.612969 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a6528ced-650a-48bc-8b32-944b1284c937 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:17.617202 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-5c8c4b67-db01-40c6-85a0-14eb3f245d70 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:17.617896 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-5c8c4b67-db01-40c6-85a0-14eb3f245d70 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:17.623890 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5c8c4b67-db01-40c6-85a0-14eb3f245d70 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:17.626730 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5c8c4b67-db01-40c6-85a0-14eb3f245d70 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:17.626730 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5c8c4b67-db01-40c6-85a0-14eb3f245d70 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:17.626730 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5c8c4b67-db01-40c6-85a0-14eb3f245d70 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:17.805527 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-5c8c4b67-db01-40c6-85a0-14eb3f245d70 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:17.813881 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-5c8c4b67-db01-40c6-85a0-14eb3f245d70 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1573 microversion: 2.1 time: 0.201360 Oct 28 09:52:17.814785 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 242/507] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:17 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1573 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:17.816096 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.network.security_group_api [None req-a6528ced-650a-48bc-8b32-944b1284c937 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Adding security group 5cc117c9-e153-4e2c-b2ac-8b040482d5c1 to port cbe862a5-40a7-43ef-b2b3-73aad1487228 Oct 28 09:52:18.060462 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-6cce68d8-1853-4ac6-bf68-0e9e0ac70f76 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:18.069626 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-6cce68d8-1853-4ac6-bf68-0e9e0ac70f76 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:18.069626 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6cce68d8-1853-4ac6-bf68-0e9e0ac70f76 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:18.069626 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6cce68d8-1853-4ac6-bf68-0e9e0ac70f76 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:18.069626 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6cce68d8-1853-4ac6-bf68-0e9e0ac70f76 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:18.070059 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6cce68d8-1853-4ac6-bf68-0e9e0ac70f76 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:18.413864 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-6cce68d8-1853-4ac6-bf68-0e9e0ac70f76 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:18.441566 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-6cce68d8-1853-4ac6-bf68-0e9e0ac70f76 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:18.458809 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-6cce68d8-1853-4ac6-bf68-0e9e0ac70f76 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:18.461608 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-6cce68d8-1853-4ac6-bf68-0e9e0ac70f76 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1812 microversion: 2.20 time: 0.406966 Oct 28 09:52:18.464063 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 243/508] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:52:18 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1812 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:52:18.485295 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-c2612f90-cbd2-40a7-8948-12e9de51f6c7 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:18.486321 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-c2612f90-cbd2-40a7-8948-12e9de51f6c7 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: b30699c5-d498-474f-a5eb-74b20b81e5ca] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:18.495211 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c2612f90-cbd2-40a7-8948-12e9de51f6c7 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:18.496534 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c2612f90-cbd2-40a7-8948-12e9de51f6c7 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:18.500950 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c2612f90-cbd2-40a7-8948-12e9de51f6c7 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:18.500950 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c2612f90-cbd2-40a7-8948-12e9de51f6c7 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:18.600099 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-c2612f90-cbd2-40a7-8948-12e9de51f6c7 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:18.609647 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-c2612f90-cbd2-40a7-8948-12e9de51f6c7 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca" status: 200 len: 1275 microversion: 2.1 time: 0.143828 Oct 28 09:52:18.610575 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 244/509] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:18 2021] GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca => generated 1275 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:18.696535 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-a6528ced-650a-48bc-8b32-944b1284c937 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "POST /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232/action" status: 202 len: 0 microversion: 2.1 time: 1.100272 Oct 28 09:52:18.698194 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 266/510] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:52:17 2021] POST /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232/action => generated 0 bytes in 1103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 09:52:18.721614 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-86c98597-31f6-40a8-89d3-926332e147bb tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:18.725218 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-86c98597-31f6-40a8-89d3-926332e147bb tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:18.742100 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-86c98597-31f6-40a8-89d3-926332e147bb tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:18.742507 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-86c98597-31f6-40a8-89d3-926332e147bb tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:18.745982 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-86c98597-31f6-40a8-89d3-926332e147bb tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:18.750422 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-86c98597-31f6-40a8-89d3-926332e147bb tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:18.767605 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [req-bca488a4-a28d-4877-addf-25b32099d64e req-ac57754c-2fb2-443c-b2de-9b6a5935a7eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d623582-8352-4294-9aca-086539f32232", "tag": "cbe862a5-40a7-43ef-b2b3-73aad1487228"}]} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:18.769689 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:52:18.769689 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 09:52:18.787162 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-bca488a4-a28d-4877-addf-25b32099d64e req-ac57754c-2fb2-443c-b2de-9b6a5935a7eb service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:18.788017 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-bca488a4-a28d-4877-addf-25b32099d64e req-ac57754c-2fb2-443c-b2de-9b6a5935a7eb service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:18.821565 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.compute.server_external_events [req-bca488a4-a28d-4877-addf-25b32099d64e req-ac57754c-2fb2-443c-b2de-9b6a5935a7eb service nova] Creating event network-changed:cbe862a5-40a7-43ef-b2b3-73aad1487228 for instance 2d623582-8352-4294-9aca-086539f32232 on hv-cinder-81571 Oct 28 09:52:18.844344 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [req-bca488a4-a28d-4877-addf-25b32099d64e req-ac57754c-2fb2-443c-b2de-9b6a5935a7eb service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077756 Oct 28 09:52:18.845738 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 267/511] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:52:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:18.856170 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-5e529b86-2fd5-4bd6-8450-dd081a45ebab tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:18.861190 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-5e529b86-2fd5-4bd6-8450-dd081a45ebab tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:18.873168 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5e529b86-2fd5-4bd6-8450-dd081a45ebab tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:18.876338 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5e529b86-2fd5-4bd6-8450-dd081a45ebab tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:18.877632 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5e529b86-2fd5-4bd6-8450-dd081a45ebab tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:18.878190 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5e529b86-2fd5-4bd6-8450-dd081a45ebab tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:19.099796 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-86c98597-31f6-40a8-89d3-926332e147bb tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:19.116425 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-86c98597-31f6-40a8-89d3-926332e147bb tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1763 microversion: 2.1 time: 0.413931 Oct 28 09:52:19.117329 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 245/512] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:18 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1763 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:19.208777 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-5e529b86-2fd5-4bd6-8450-dd081a45ebab tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:19.218892 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-5e529b86-2fd5-4bd6-8450-dd081a45ebab tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1573 microversion: 2.1 time: 0.371671 Oct 28 09:52:19.219966 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 268/513] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:18 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1573 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:19.494556 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-e77b4a8f-b9ea-4d39-b9b7-813ed14405f8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:19.496728 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-e77b4a8f-b9ea-4d39-b9b7-813ed14405f8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:19.508298 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e77b4a8f-b9ea-4d39-b9b7-813ed14405f8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:19.510240 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e77b4a8f-b9ea-4d39-b9b7-813ed14405f8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:19.511351 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e77b4a8f-b9ea-4d39-b9b7-813ed14405f8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:19.511961 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e77b4a8f-b9ea-4d39-b9b7-813ed14405f8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:19.628436 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-e2bbbf92-5aae-49c4-847a-121f15380a3e tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:19.629907 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-e2bbbf92-5aae-49c4-847a-121f15380a3e tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: b30699c5-d498-474f-a5eb-74b20b81e5ca] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:19.640852 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e2bbbf92-5aae-49c4-847a-121f15380a3e tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:19.647394 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e2bbbf92-5aae-49c4-847a-121f15380a3e tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:19.648226 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e2bbbf92-5aae-49c4-847a-121f15380a3e tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:19.648948 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e2bbbf92-5aae-49c4-847a-121f15380a3e tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:20.062601 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-e77b4a8f-b9ea-4d39-b9b7-813ed14405f8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:20.073759 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-e77b4a8f-b9ea-4d39-b9b7-813ed14405f8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:20.075279 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-e77b4a8f-b9ea-4d39-b9b7-813ed14405f8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:20.076792 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-e77b4a8f-b9ea-4d39-b9b7-813ed14405f8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1799 microversion: 2.20 time: 0.594215 Oct 28 09:52:20.108968 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 246/514] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:52:19 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1799 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:52:20.144731 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-e2bbbf92-5aae-49c4-847a-121f15380a3e tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:20.153366 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-e2bbbf92-5aae-49c4-847a-121f15380a3e tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca" status: 200 len: 1317 microversion: 2.1 time: 0.529132 Oct 28 09:52:20.153993 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 269/515] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:19 2021] GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca => generated 1317 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:52:20.237641 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-27bfee7b-7953-400b-b42d-81a916f5b9d5 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:20.238257 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-27bfee7b-7953-400b-b42d-81a916f5b9d5 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:20.244521 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-27bfee7b-7953-400b-b42d-81a916f5b9d5 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:20.245005 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-27bfee7b-7953-400b-b42d-81a916f5b9d5 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:20.245785 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-27bfee7b-7953-400b-b42d-81a916f5b9d5 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:20.246216 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-27bfee7b-7953-400b-b42d-81a916f5b9d5 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:20.350695 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [req-a87fb9c8-fbd7-4dc1-84dc-054646d51019 req-ae9ce189-28c9-456c-93d1-b6cb6a6a2654 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b30699c5-d498-474f-a5eb-74b20b81e5ca", "tag": "4c19ecb1-5769-49fb-b9f1-5a76a6591766"}]} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:20.353703 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:52:20.353703 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 09:52:20.362147 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-a87fb9c8-fbd7-4dc1-84dc-054646d51019 req-ae9ce189-28c9-456c-93d1-b6cb6a6a2654 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:20.363348 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-a87fb9c8-fbd7-4dc1-84dc-054646d51019 req-ae9ce189-28c9-456c-93d1-b6cb6a6a2654 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:20.377340 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.compute.server_external_events [req-a87fb9c8-fbd7-4dc1-84dc-054646d51019 req-ae9ce189-28c9-456c-93d1-b6cb6a6a2654 service nova] Creating event network-changed:4c19ecb1-5769-49fb-b9f1-5a76a6591766 for instance b30699c5-d498-474f-a5eb-74b20b81e5ca on hv-cinder-81571 Oct 28 09:52:20.383678 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [req-a87fb9c8-fbd7-4dc1-84dc-054646d51019 req-ae9ce189-28c9-456c-93d1-b6cb6a6a2654 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036844 Oct 28 09:52:20.385237 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 270/516] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:52:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:52:20.395055 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-27bfee7b-7953-400b-b42d-81a916f5b9d5 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:20.403877 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-27bfee7b-7953-400b-b42d-81a916f5b9d5 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1573 microversion: 2.1 time: 0.169824 Oct 28 09:52:20.404448 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 247/517] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:20 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1573 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:21.176094 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-c884968c-57d0-4389-81fc-b831e2ad4495 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:21.177044 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-c884968c-57d0-4389-81fc-b831e2ad4495 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: b30699c5-d498-474f-a5eb-74b20b81e5ca] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:21.184750 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c884968c-57d0-4389-81fc-b831e2ad4495 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:21.185197 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c884968c-57d0-4389-81fc-b831e2ad4495 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:21.185988 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c884968c-57d0-4389-81fc-b831e2ad4495 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:21.186492 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c884968c-57d0-4389-81fc-b831e2ad4495 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:21.326080 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-c884968c-57d0-4389-81fc-b831e2ad4495 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:21.338225 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-c884968c-57d0-4389-81fc-b831e2ad4495 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca" status: 200 len: 1317 microversion: 2.1 time: 0.166436 Oct 28 09:52:21.339447 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 271/518] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:21 2021] GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:21.421262 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-2973dd37-dcb9-45a7-b751-71fb7332d1c6 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:21.422014 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-2973dd37-dcb9-45a7-b751-71fb7332d1c6 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:21.429974 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2973dd37-dcb9-45a7-b751-71fb7332d1c6 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:21.430684 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2973dd37-dcb9-45a7-b751-71fb7332d1c6 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:21.431207 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2973dd37-dcb9-45a7-b751-71fb7332d1c6 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:21.431638 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2973dd37-dcb9-45a7-b751-71fb7332d1c6 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:21.564467 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-2973dd37-dcb9-45a7-b751-71fb7332d1c6 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:21.573852 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-2973dd37-dcb9-45a7-b751-71fb7332d1c6 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1573 microversion: 2.1 time: 0.156306 Oct 28 09:52:21.574421 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 248/519] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:21 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:22.363616 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-5240d6f0-713c-4c50-a326-97ef697a5034 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:22.364202 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-5240d6f0-713c-4c50-a326-97ef697a5034 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: b30699c5-d498-474f-a5eb-74b20b81e5ca] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:22.371851 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5240d6f0-713c-4c50-a326-97ef697a5034 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:22.372293 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5240d6f0-713c-4c50-a326-97ef697a5034 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:22.373101 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5240d6f0-713c-4c50-a326-97ef697a5034 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:22.373520 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5240d6f0-713c-4c50-a326-97ef697a5034 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:22.520020 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-5240d6f0-713c-4c50-a326-97ef697a5034 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:22.528432 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-5240d6f0-713c-4c50-a326-97ef697a5034 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca" status: 200 len: 1317 microversion: 2.1 time: 0.170036 Oct 28 09:52:22.529068 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 272/520] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:22 2021] GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:22.592091 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-5e1cccc8-c9c0-439e-943e-734c3512ee39 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:22.592721 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-5e1cccc8-c9c0-439e-943e-734c3512ee39 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:22.600110 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5e1cccc8-c9c0-439e-943e-734c3512ee39 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:22.600801 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5e1cccc8-c9c0-439e-943e-734c3512ee39 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:22.601661 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5e1cccc8-c9c0-439e-943e-734c3512ee39 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:22.602122 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5e1cccc8-c9c0-439e-943e-734c3512ee39 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:22.731118 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-5e1cccc8-c9c0-439e-943e-734c3512ee39 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:22.741338 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-5e1cccc8-c9c0-439e-943e-734c3512ee39 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1573 microversion: 2.1 time: 0.153273 Oct 28 09:52:22.741982 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 249/521] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:22 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:23.546294 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-9e117fb1-56d2-4766-8e07-55353f8d75a2 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:23.547037 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-9e117fb1-56d2-4766-8e07-55353f8d75a2 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: b30699c5-d498-474f-a5eb-74b20b81e5ca] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:23.553594 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9e117fb1-56d2-4766-8e07-55353f8d75a2 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:23.554123 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9e117fb1-56d2-4766-8e07-55353f8d75a2 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:23.554838 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9e117fb1-56d2-4766-8e07-55353f8d75a2 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:23.555854 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9e117fb1-56d2-4766-8e07-55353f8d75a2 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:23.698913 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-9e117fb1-56d2-4766-8e07-55353f8d75a2 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:23.706603 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-9e117fb1-56d2-4766-8e07-55353f8d75a2 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca" status: 200 len: 1317 microversion: 2.1 time: 0.164141 Oct 28 09:52:23.707473 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 273/522] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:23 2021] GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:23.762120 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-5fdcef91-d2d0-462d-86cb-548ef2bbb870 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:23.762963 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-5fdcef91-d2d0-462d-86cb-548ef2bbb870 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:23.771036 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5fdcef91-d2d0-462d-86cb-548ef2bbb870 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:23.771714 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5fdcef91-d2d0-462d-86cb-548ef2bbb870 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:23.772838 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5fdcef91-d2d0-462d-86cb-548ef2bbb870 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:23.773419 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5fdcef91-d2d0-462d-86cb-548ef2bbb870 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:23.920081 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-5fdcef91-d2d0-462d-86cb-548ef2bbb870 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:23.931856 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-5fdcef91-d2d0-462d-86cb-548ef2bbb870 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1573 microversion: 2.1 time: 0.173514 Oct 28 09:52:23.931856 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 250/523] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:23 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1573 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:24.732181 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-6c06d0ba-bd94-4e2a-be75-b2d24c789167 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:24.736477 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-6c06d0ba-bd94-4e2a-be75-b2d24c789167 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: b30699c5-d498-474f-a5eb-74b20b81e5ca] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:24.739773 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6c06d0ba-bd94-4e2a-be75-b2d24c789167 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:24.740289 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6c06d0ba-bd94-4e2a-be75-b2d24c789167 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:24.741259 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6c06d0ba-bd94-4e2a-be75-b2d24c789167 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:24.742377 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6c06d0ba-bd94-4e2a-be75-b2d24c789167 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:24.918565 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-6c06d0ba-bd94-4e2a-be75-b2d24c789167 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:24.926105 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-6c06d0ba-bd94-4e2a-be75-b2d24c789167 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca" status: 200 len: 1317 microversion: 2.1 time: 0.203394 Oct 28 09:52:24.926668 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 274/524] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:24 2021] GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:24.949982 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-b2e5618c-65db-40bb-b6f8-122cc316c97d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:24.950819 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-b2e5618c-65db-40bb-b6f8-122cc316c97d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:24.957336 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b2e5618c-65db-40bb-b6f8-122cc316c97d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:24.957816 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b2e5618c-65db-40bb-b6f8-122cc316c97d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:24.958599 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b2e5618c-65db-40bb-b6f8-122cc316c97d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:24.959055 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b2e5618c-65db-40bb-b6f8-122cc316c97d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:25.101387 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-b2e5618c-65db-40bb-b6f8-122cc316c97d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:25.109967 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-b2e5618c-65db-40bb-b6f8-122cc316c97d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1573 microversion: 2.1 time: 0.163724 Oct 28 09:52:25.110532 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 251/525] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:24 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1573 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:25.944881 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-379e87c9-d300-4ae9-b7a6-8e28dd153bce tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:25.945531 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-379e87c9-d300-4ae9-b7a6-8e28dd153bce tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: b30699c5-d498-474f-a5eb-74b20b81e5ca] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:25.952620 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-379e87c9-d300-4ae9-b7a6-8e28dd153bce tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:25.953092 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-379e87c9-d300-4ae9-b7a6-8e28dd153bce tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:25.953883 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-379e87c9-d300-4ae9-b7a6-8e28dd153bce tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:25.954313 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-379e87c9-d300-4ae9-b7a6-8e28dd153bce tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:26.088045 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-379e87c9-d300-4ae9-b7a6-8e28dd153bce tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:26.095600 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-379e87c9-d300-4ae9-b7a6-8e28dd153bce tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca" status: 200 len: 1317 microversion: 2.1 time: 0.155064 Oct 28 09:52:26.096208 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 275/526] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:25 2021] GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:26.128109 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-cae0efa9-aaf7-49cd-9bb3-5cd2f3f012d8 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:26.128109 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-cae0efa9-aaf7-49cd-9bb3-5cd2f3f012d8 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:26.134653 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cae0efa9-aaf7-49cd-9bb3-5cd2f3f012d8 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:26.142103 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cae0efa9-aaf7-49cd-9bb3-5cd2f3f012d8 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:26.142103 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cae0efa9-aaf7-49cd-9bb3-5cd2f3f012d8 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:26.142103 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cae0efa9-aaf7-49cd-9bb3-5cd2f3f012d8 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:26.268236 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-cae0efa9-aaf7-49cd-9bb3-5cd2f3f012d8 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:26.276800 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-cae0efa9-aaf7-49cd-9bb3-5cd2f3f012d8 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1573 microversion: 2.1 time: 0.153301 Oct 28 09:52:26.277380 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 252/527] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:26 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:27.019461 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [req-1208a870-79a5-48e8-a0ca-89ca0cde0ba7 req-ea7f642c-9256-4fca-8cd2-c095eba4d233 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b30699c5-d498-474f-a5eb-74b20b81e5ca", "name": "network-vif-plugged", "status": "completed", "tag": "4c19ecb1-5769-49fb-b9f1-5a76a6591766"}]} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:27.023736 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:52:27.023736 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 09:52:27.031854 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-1208a870-79a5-48e8-a0ca-89ca0cde0ba7 req-ea7f642c-9256-4fca-8cd2-c095eba4d233 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:27.032289 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-1208a870-79a5-48e8-a0ca-89ca0cde0ba7 req-ea7f642c-9256-4fca-8cd2-c095eba4d233 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:27.044569 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.compute.server_external_events [req-1208a870-79a5-48e8-a0ca-89ca0cde0ba7 req-ea7f642c-9256-4fca-8cd2-c095eba4d233 service nova] Creating event network-vif-plugged:4c19ecb1-5769-49fb-b9f1-5a76a6591766 for instance b30699c5-d498-474f-a5eb-74b20b81e5ca on hv-cinder-81571 Oct 28 09:52:27.049540 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [req-1208a870-79a5-48e8-a0ca-89ca0cde0ba7 req-ea7f642c-9256-4fca-8cd2-c095eba4d233 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034849 Oct 28 09:52:27.050188 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 276/528] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:52:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:27.113123 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-6e8e5d90-ba25-4ce8-8d7c-690379db37d9 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:27.113723 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-6e8e5d90-ba25-4ce8-8d7c-690379db37d9 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: b30699c5-d498-474f-a5eb-74b20b81e5ca] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:27.120937 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6e8e5d90-ba25-4ce8-8d7c-690379db37d9 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:27.121384 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6e8e5d90-ba25-4ce8-8d7c-690379db37d9 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:27.122161 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6e8e5d90-ba25-4ce8-8d7c-690379db37d9 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:27.122668 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6e8e5d90-ba25-4ce8-8d7c-690379db37d9 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:27.277762 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-6e8e5d90-ba25-4ce8-8d7c-690379db37d9 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:27.285418 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-6e8e5d90-ba25-4ce8-8d7c-690379db37d9 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca" status: 200 len: 1317 microversion: 2.1 time: 0.175858 Oct 28 09:52:27.286077 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 253/529] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:27 2021] GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:27.294772 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-6ebeeb7d-e0df-4732-a230-f2c5561c0087 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:27.295711 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-6ebeeb7d-e0df-4732-a230-f2c5561c0087 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:27.301996 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6ebeeb7d-e0df-4732-a230-f2c5561c0087 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:27.307122 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6ebeeb7d-e0df-4732-a230-f2c5561c0087 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:27.307122 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6ebeeb7d-e0df-4732-a230-f2c5561c0087 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:27.307122 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6ebeeb7d-e0df-4732-a230-f2c5561c0087 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:27.442820 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-6ebeeb7d-e0df-4732-a230-f2c5561c0087 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:27.451878 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-6ebeeb7d-e0df-4732-a230-f2c5561c0087 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1573 microversion: 2.1 time: 0.161414 Oct 28 09:52:27.452448 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 277/530] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:27 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1573 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:28.302259 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-7e1394f9-1706-41ac-ae77-fb3a0cd9fc6c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:28.302848 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-7e1394f9-1706-41ac-ae77-fb3a0cd9fc6c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: b30699c5-d498-474f-a5eb-74b20b81e5ca] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:28.309712 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7e1394f9-1706-41ac-ae77-fb3a0cd9fc6c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:28.310161 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7e1394f9-1706-41ac-ae77-fb3a0cd9fc6c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:28.310930 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7e1394f9-1706-41ac-ae77-fb3a0cd9fc6c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:28.311356 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7e1394f9-1706-41ac-ae77-fb3a0cd9fc6c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:28.448676 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-7e1394f9-1706-41ac-ae77-fb3a0cd9fc6c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:28.456901 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-7e1394f9-1706-41ac-ae77-fb3a0cd9fc6c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca" status: 200 len: 1317 microversion: 2.1 time: 0.158073 Oct 28 09:52:28.457479 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 254/531] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:28 2021] GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:28.468848 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-a3667049-7692-45a3-b8a6-4d5173933c4c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:28.469449 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-a3667049-7692-45a3-b8a6-4d5173933c4c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:28.476214 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a3667049-7692-45a3-b8a6-4d5173933c4c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:28.476643 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a3667049-7692-45a3-b8a6-4d5173933c4c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:28.477679 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a3667049-7692-45a3-b8a6-4d5173933c4c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:28.478143 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a3667049-7692-45a3-b8a6-4d5173933c4c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:28.603604 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-a3667049-7692-45a3-b8a6-4d5173933c4c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:28.611452 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-a3667049-7692-45a3-b8a6-4d5173933c4c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1573 microversion: 2.1 time: 0.146199 Oct 28 09:52:28.612178 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 278/532] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:28 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1573 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:29.475259 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-e96d7836-6918-475b-ac9f-4b20923572e9 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:29.475870 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-e96d7836-6918-475b-ac9f-4b20923572e9 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: b30699c5-d498-474f-a5eb-74b20b81e5ca] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:29.483106 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e96d7836-6918-475b-ac9f-4b20923572e9 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:29.483558 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e96d7836-6918-475b-ac9f-4b20923572e9 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:29.484343 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e96d7836-6918-475b-ac9f-4b20923572e9 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:29.484804 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e96d7836-6918-475b-ac9f-4b20923572e9 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:29.614361 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-e96d7836-6918-475b-ac9f-4b20923572e9 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:29.622637 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-e96d7836-6918-475b-ac9f-4b20923572e9 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca" status: 200 len: 1317 microversion: 2.1 time: 0.150973 Oct 28 09:52:29.623234 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 255/533] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:29 2021] GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:29.629180 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-380e4881-5db0-468c-801c-87af9d76c1f0 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:29.629897 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-380e4881-5db0-468c-801c-87af9d76c1f0 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:29.637693 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-380e4881-5db0-468c-801c-87af9d76c1f0 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:29.638136 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-380e4881-5db0-468c-801c-87af9d76c1f0 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:29.638918 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-380e4881-5db0-468c-801c-87af9d76c1f0 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:29.639346 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-380e4881-5db0-468c-801c-87af9d76c1f0 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:29.767507 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-380e4881-5db0-468c-801c-87af9d76c1f0 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:29.776412 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-380e4881-5db0-468c-801c-87af9d76c1f0 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1573 microversion: 2.1 time: 0.150865 Oct 28 09:52:29.777015 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 279/534] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:29 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:30.641749 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-8215bee9-9cc5-470d-a813-4168f5331096 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:30.642446 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-8215bee9-9cc5-470d-a813-4168f5331096 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: b30699c5-d498-474f-a5eb-74b20b81e5ca] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:30.649585 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8215bee9-9cc5-470d-a813-4168f5331096 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:30.650027 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8215bee9-9cc5-470d-a813-4168f5331096 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:30.650801 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8215bee9-9cc5-470d-a813-4168f5331096 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:30.651222 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8215bee9-9cc5-470d-a813-4168f5331096 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:30.787947 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-8215bee9-9cc5-470d-a813-4168f5331096 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:30.798169 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-b2b7cd94-a238-47fb-a06a-c0e35d212d0c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:30.799323 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-b2b7cd94-a238-47fb-a06a-c0e35d212d0c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:30.806912 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-8215bee9-9cc5-470d-a813-4168f5331096 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca" status: 200 len: 1317 microversion: 2.1 time: 0.164523 Oct 28 09:52:30.806912 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 256/535] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:30 2021] GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:30.808346 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b2b7cd94-a238-47fb-a06a-c0e35d212d0c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:30.809161 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b2b7cd94-a238-47fb-a06a-c0e35d212d0c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:30.810167 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b2b7cd94-a238-47fb-a06a-c0e35d212d0c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:30.810789 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b2b7cd94-a238-47fb-a06a-c0e35d212d0c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:30.969597 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-b2b7cd94-a238-47fb-a06a-c0e35d212d0c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:30.980760 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-b2b7cd94-a238-47fb-a06a-c0e35d212d0c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1573 microversion: 2.1 time: 0.190439 Oct 28 09:52:30.981458 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 280/536] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:30 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1573 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:52:31.823188 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-7d426143-e15f-4854-a986-7d13612be8f4 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:31.824241 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-7d426143-e15f-4854-a986-7d13612be8f4 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: b30699c5-d498-474f-a5eb-74b20b81e5ca] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:31.835286 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7d426143-e15f-4854-a986-7d13612be8f4 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:31.836081 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7d426143-e15f-4854-a986-7d13612be8f4 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:31.837730 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7d426143-e15f-4854-a986-7d13612be8f4 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:31.838520 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7d426143-e15f-4854-a986-7d13612be8f4 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:31.981889 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-7d426143-e15f-4854-a986-7d13612be8f4 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:31.989109 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-7d426143-e15f-4854-a986-7d13612be8f4 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca" status: 200 len: 1500 microversion: 2.1 time: 0.172548 Oct 28 09:52:31.989815 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 257/537] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:31 2021] GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca => generated 1500 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:31.998571 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-d3e69943-db16-48e7-a1ec-a4b42381683c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:31.999187 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-d3e69943-db16-48e7-a1ec-a4b42381683c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:32.005386 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d3e69943-db16-48e7-a1ec-a4b42381683c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:32.005894 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d3e69943-db16-48e7-a1ec-a4b42381683c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:32.011262 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d3e69943-db16-48e7-a1ec-a4b42381683c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:32.016791 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d3e69943-db16-48e7-a1ec-a4b42381683c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:32.144527 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-d3e69943-db16-48e7-a1ec-a4b42381683c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:32.153193 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-d3e69943-db16-48e7-a1ec-a4b42381683c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1573 microversion: 2.1 time: 0.158296 Oct 28 09:52:32.153769 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 281/538] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:31 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:33.063875 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-c4b3d7af-8d4f-452b-9fd2-2ea88990b5fc tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:33.065268 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-c4b3d7af-8d4f-452b-9fd2-2ea88990b5fc tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: b30699c5-d498-474f-a5eb-74b20b81e5ca] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:33.071699 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c4b3d7af-8d4f-452b-9fd2-2ea88990b5fc tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:33.072207 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c4b3d7af-8d4f-452b-9fd2-2ea88990b5fc tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:33.073014 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c4b3d7af-8d4f-452b-9fd2-2ea88990b5fc tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:33.073437 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c4b3d7af-8d4f-452b-9fd2-2ea88990b5fc tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:33.106060 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-c4b3d7af-8d4f-452b-9fd2-2ea88990b5fc tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: b30699c5-d498-474f-a5eb-74b20b81e5ca] Going to try to terminate instance {{(pid=123068) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 09:52:33.170990 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-c8a9c9b6-6764-4369-8b3b-f056b6979c1a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:33.171571 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-c8a9c9b6-6764-4369-8b3b-f056b6979c1a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:33.177996 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c8a9c9b6-6764-4369-8b3b-f056b6979c1a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:33.178430 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c8a9c9b6-6764-4369-8b3b-f056b6979c1a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:33.179189 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c8a9c9b6-6764-4369-8b3b-f056b6979c1a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:33.179607 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c8a9c9b6-6764-4369-8b3b-f056b6979c1a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:33.317207 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-c8a9c9b6-6764-4369-8b3b-f056b6979c1a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:33.324426 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-c8a9c9b6-6764-4369-8b3b-f056b6979c1a tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1573 microversion: 2.1 time: 0.157127 Oct 28 09:52:33.325174 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 282/539] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:33 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:52:33.411854 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-c4b3d7af-8d4f-452b-9fd2-2ea88990b5fc tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "DELETE /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca" status: 204 len: 0 microversion: 2.1 time: 0.351391 Oct 28 09:52:33.412588 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 258/540] 10.222.0.104 () {58 vars in 1243 bytes} [Thu Oct 28 09:52:33 2021] DELETE /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:52:33.424478 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-54d3d1e8-a643-4d7a-8d57-98a8e8b8107a tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:33.425283 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-54d3d1e8-a643-4d7a-8d57-98a8e8b8107a tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: b30699c5-d498-474f-a5eb-74b20b81e5ca] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:33.435157 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-54d3d1e8-a643-4d7a-8d57-98a8e8b8107a tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:33.435609 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-54d3d1e8-a643-4d7a-8d57-98a8e8b8107a tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:33.436392 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-54d3d1e8-a643-4d7a-8d57-98a8e8b8107a tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:33.436853 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-54d3d1e8-a643-4d7a-8d57-98a8e8b8107a tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:33.564599 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-54d3d1e8-a643-4d7a-8d57-98a8e8b8107a tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:33.575389 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-54d3d1e8-a643-4d7a-8d57-98a8e8b8107a tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca" status: 200 len: 1506 microversion: 2.1 time: 0.158200 Oct 28 09:52:33.575971 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 283/541] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:33 2021] GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:34.342553 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-3dd8d789-eecd-4342-959e-345884c0c149 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:34.343247 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-3dd8d789-eecd-4342-959e-345884c0c149 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:34.350334 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3dd8d789-eecd-4342-959e-345884c0c149 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:34.350771 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3dd8d789-eecd-4342-959e-345884c0c149 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:34.351545 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3dd8d789-eecd-4342-959e-345884c0c149 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:34.352610 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3dd8d789-eecd-4342-959e-345884c0c149 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:34.487143 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-3dd8d789-eecd-4342-959e-345884c0c149 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:34.495759 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-3dd8d789-eecd-4342-959e-345884c0c149 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1573 microversion: 2.1 time: 0.157283 Oct 28 09:52:34.496327 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 259/542] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:34 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:34.596383 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-1659f7d3-11a5-4997-91b4-72585dea4d07 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:34.598854 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-1659f7d3-11a5-4997-91b4-72585dea4d07 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: b30699c5-d498-474f-a5eb-74b20b81e5ca] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:34.610133 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1659f7d3-11a5-4997-91b4-72585dea4d07 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:34.610582 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1659f7d3-11a5-4997-91b4-72585dea4d07 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:34.611362 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1659f7d3-11a5-4997-91b4-72585dea4d07 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:34.611787 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1659f7d3-11a5-4997-91b4-72585dea4d07 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:34.744790 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-1659f7d3-11a5-4997-91b4-72585dea4d07 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:34.752138 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-1659f7d3-11a5-4997-91b4-72585dea4d07 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca" status: 200 len: 1506 microversion: 2.1 time: 0.161554 Oct 28 09:52:34.752713 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 284/543] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:34 2021] GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:52:35.515438 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-03a1555a-1b47-4baa-82d0-fba5382374ac tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:35.516070 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-03a1555a-1b47-4baa-82d0-fba5382374ac tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:35.522637 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-03a1555a-1b47-4baa-82d0-fba5382374ac tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:35.523130 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-03a1555a-1b47-4baa-82d0-fba5382374ac tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:35.524072 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-03a1555a-1b47-4baa-82d0-fba5382374ac tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:35.524877 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-03a1555a-1b47-4baa-82d0-fba5382374ac tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:35.668820 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-03a1555a-1b47-4baa-82d0-fba5382374ac tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:35.685435 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-03a1555a-1b47-4baa-82d0-fba5382374ac tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1573 microversion: 2.1 time: 0.173775 Oct 28 09:52:35.686578 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 260/544] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:35 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1573 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:35.770959 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-bb9464bf-5453-4d2d-a1de-c9c9c342188c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:35.771529 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-bb9464bf-5453-4d2d-a1de-c9c9c342188c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: b30699c5-d498-474f-a5eb-74b20b81e5ca] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:35.778328 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bb9464bf-5453-4d2d-a1de-c9c9c342188c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:35.779552 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bb9464bf-5453-4d2d-a1de-c9c9c342188c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:35.780455 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bb9464bf-5453-4d2d-a1de-c9c9c342188c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:35.781261 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bb9464bf-5453-4d2d-a1de-c9c9c342188c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:35.954065 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-bb9464bf-5453-4d2d-a1de-c9c9c342188c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:35.966537 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-bb9464bf-5453-4d2d-a1de-c9c9c342188c tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca" status: 200 len: 1506 microversion: 2.1 time: 0.200565 Oct 28 09:52:35.970573 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 285/545] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:35 2021] GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca => generated 1506 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:36.237659 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-61e087c7-34b0-43cd-a37f-e3dbf6f17050 req-20e1fc7a-49a6-4850-aa86-75be6eaa9714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b30699c5-d498-474f-a5eb-74b20b81e5ca", "name": "network-vif-deleted", "tag": "4c19ecb1-5769-49fb-b9f1-5a76a6591766"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:36.239228 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:52:36.239228 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:52:36.246737 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-61e087c7-34b0-43cd-a37f-e3dbf6f17050 req-20e1fc7a-49a6-4850-aa86-75be6eaa9714 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:36.247166 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-61e087c7-34b0-43cd-a37f-e3dbf6f17050 req-20e1fc7a-49a6-4850-aa86-75be6eaa9714 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:36.258952 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-61e087c7-34b0-43cd-a37f-e3dbf6f17050 req-20e1fc7a-49a6-4850-aa86-75be6eaa9714 service nova] Creating event network-vif-deleted:4c19ecb1-5769-49fb-b9f1-5a76a6591766 for instance b30699c5-d498-474f-a5eb-74b20b81e5ca on hv-cinder-81571 Oct 28 09:52:36.263816 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-61e087c7-34b0-43cd-a37f-e3dbf6f17050 req-20e1fc7a-49a6-4850-aa86-75be6eaa9714 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030024 Oct 28 09:52:36.264461 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 261/546] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:52:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:36.703070 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-2d6d322b-9481-4667-abeb-4bf69a242932 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:36.703676 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-2d6d322b-9481-4667-abeb-4bf69a242932 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:36.712236 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2d6d322b-9481-4667-abeb-4bf69a242932 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:36.712771 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2d6d322b-9481-4667-abeb-4bf69a242932 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:36.713615 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2d6d322b-9481-4667-abeb-4bf69a242932 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:36.714065 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2d6d322b-9481-4667-abeb-4bf69a242932 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:36.850033 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-2d6d322b-9481-4667-abeb-4bf69a242932 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:36.858042 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-2d6d322b-9481-4667-abeb-4bf69a242932 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1573 microversion: 2.1 time: 0.158618 Oct 28 09:52:36.858604 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 286/547] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:36 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:36.986023 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-a04b8e64-ce9a-4f7e-ab52-4b3be6666a76 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:36.986714 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-a04b8e64-ce9a-4f7e-ab52-4b3be6666a76 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: b30699c5-d498-474f-a5eb-74b20b81e5ca] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:36.993702 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a04b8e64-ce9a-4f7e-ab52-4b3be6666a76 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:36.994138 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a04b8e64-ce9a-4f7e-ab52-4b3be6666a76 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:36.994902 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a04b8e64-ce9a-4f7e-ab52-4b3be6666a76 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:36.995409 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a04b8e64-ce9a-4f7e-ab52-4b3be6666a76 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:37.028762 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a04b8e64-ce9a-4f7e-ab52-4b3be6666a76 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:37.029190 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a04b8e64-ce9a-4f7e-ab52-4b3be6666a76 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:37.029635 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.objects.instance [None req-a04b8e64-ce9a-4f7e-ab52-4b3be6666a76 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lazy-loading 'fault' on Instance uuid b30699c5-d498-474f-a5eb-74b20b81e5ca {{(pid=123068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 09:52:37.073498 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-a04b8e64-ce9a-4f7e-ab52-4b3be6666a76 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e13e30490a54220ad0df4feee2ffcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487a772480347a0b31aebb5f8cf6b7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:37.082054 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-a04b8e64-ce9a-4f7e-ab52-4b3be6666a76 tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca" status: 200 len: 1307 microversion: 2.1 time: 0.099971 Oct 28 09:52:37.082636 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 262/548] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:36 2021] GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca => generated 1307 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:37.875217 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-741d7970-5b17-489b-88a5-68349d14bd40 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:37.875816 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-741d7970-5b17-489b-88a5-68349d14bd40 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:37.882539 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-741d7970-5b17-489b-88a5-68349d14bd40 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:37.883616 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-741d7970-5b17-489b-88a5-68349d14bd40 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:37.884501 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-741d7970-5b17-489b-88a5-68349d14bd40 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:37.884866 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-741d7970-5b17-489b-88a5-68349d14bd40 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:38.013188 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-741d7970-5b17-489b-88a5-68349d14bd40 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:38.021085 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-741d7970-5b17-489b-88a5-68349d14bd40 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1573 microversion: 2.1 time: 0.149435 Oct 28 09:52:38.021579 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 287/549] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:37 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1573 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:38.099571 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-ec6c9594-02ff-4a2f-b23f-d2d2e0748d3b tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:38.100287 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-ec6c9594-02ff-4a2f-b23f-d2d2e0748d3b tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] [instance: b30699c5-d498-474f-a5eb-74b20b81e5ca] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:38.106889 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ec6c9594-02ff-4a2f-b23f-d2d2e0748d3b tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:38.107327 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ec6c9594-02ff-4a2f-b23f-d2d2e0748d3b tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:38.108092 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ec6c9594-02ff-4a2f-b23f-d2d2e0748d3b tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:38.108522 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ec6c9594-02ff-4a2f-b23f-d2d2e0748d3b tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:38.121750 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.wsgi [None req-ec6c9594-02ff-4a2f-b23f-d2d2e0748d3b tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] HTTP exception thrown: Instance b30699c5-d498-474f-a5eb-74b20b81e5ca could not be found. Oct 28 09:52:38.122342 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-ec6c9594-02ff-4a2f-b23f-d2d2e0748d3b tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] Returning 404 to user: Instance b30699c5-d498-474f-a5eb-74b20b81e5ca could not be found. {{(pid=123068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:52:38.123175 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-ec6c9594-02ff-4a2f-b23f-d2d2e0748d3b tempest-VolumesActionsTest-1059718705 tempest-VolumesActionsTest-1059718705-project] 10.222.0.104 "GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca" status: 404 len: 111 microversion: 2.1 time: 0.027494 Oct 28 09:52:38.123722 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 263/550] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:38 2021] GET /compute/v2.1/servers/b30699c5-d498-474f-a5eb-74b20b81e5ca => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:52:39.040376 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-c6f73ba0-405c-453d-b6ea-324f18b45f16 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:39.041876 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-c6f73ba0-405c-453d-b6ea-324f18b45f16 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:39.048182 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c6f73ba0-405c-453d-b6ea-324f18b45f16 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:39.048753 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c6f73ba0-405c-453d-b6ea-324f18b45f16 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:39.049543 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c6f73ba0-405c-453d-b6ea-324f18b45f16 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:39.050081 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c6f73ba0-405c-453d-b6ea-324f18b45f16 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:39.177756 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-c6f73ba0-405c-453d-b6ea-324f18b45f16 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:39.196044 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-c6f73ba0-405c-453d-b6ea-324f18b45f16 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1553 microversion: 2.1 time: 0.159140 Oct 28 09:52:39.196603 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 288/551] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:39 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:39.215124 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-93a7f269-2d0b-46d3-a3e5-ec05f3215da6 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:39.215740 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-93a7f269-2d0b-46d3-a3e5-ec05f3215da6 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:39.222114 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-93a7f269-2d0b-46d3-a3e5-ec05f3215da6 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:39.222563 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-93a7f269-2d0b-46d3-a3e5-ec05f3215da6 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:39.223334 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-93a7f269-2d0b-46d3-a3e5-ec05f3215da6 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:39.223873 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-93a7f269-2d0b-46d3-a3e5-ec05f3215da6 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:39.317423 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.wsgi [None req-93a7f269-2d0b-46d3-a3e5-ec05f3215da6 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] HTTP exception thrown: Cannot 'detach_volume' instance 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f while it is in vm_state rescued Oct 28 09:52:39.317972 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-93a7f269-2d0b-46d3-a3e5-ec05f3215da6 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Returning 409 to user: Cannot 'detach_volume' instance 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f while it is in vm_state rescued {{(pid=123068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:52:39.318756 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-93a7f269-2d0b-46d3-a3e5-ec05f3215da6 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "DELETE /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f/os-volume_attachments/c3c0c6bc-ff53-496a-867d-e61518764421" status: 409 len: 152 microversion: 2.1 time: 0.108201 Oct 28 09:52:39.319305 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 264/552] 10.222.0.104 () {58 vars in 1420 bytes} [Thu Oct 28 09:52:39 2021] DELETE /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f/os-volume_attachments/c3c0c6bc-ff53-496a-867d-e61518764421 => generated 152 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 09:52:39.328433 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-a9d100ee-2659-49ea-8377-a13a08b62443 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:39.329028 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-a9d100ee-2659-49ea-8377-a13a08b62443 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:39.334723 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a9d100ee-2659-49ea-8377-a13a08b62443 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:39.335159 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a9d100ee-2659-49ea-8377-a13a08b62443 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:39.336161 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a9d100ee-2659-49ea-8377-a13a08b62443 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:39.336721 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a9d100ee-2659-49ea-8377-a13a08b62443 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:39.591741 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-a9d100ee-2659-49ea-8377-a13a08b62443 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "POST /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f/action" status: 202 len: 0 microversion: 2.1 time: 0.266730 Oct 28 09:52:39.593695 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 289/553] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:52:39 2021] POST /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:52:39.606573 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-85b56770-e470-42c8-ba1a-2bfc2c0b2459 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:39.606573 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-85b56770-e470-42c8-ba1a-2bfc2c0b2459 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:39.608667 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-85b56770-e470-42c8-ba1a-2bfc2c0b2459 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:39.609193 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-85b56770-e470-42c8-ba1a-2bfc2c0b2459 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:39.610045 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-85b56770-e470-42c8-ba1a-2bfc2c0b2459 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:39.610598 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-85b56770-e470-42c8-ba1a-2bfc2c0b2459 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:39.737083 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-85b56770-e470-42c8-ba1a-2bfc2c0b2459 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:39.745959 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-85b56770-e470-42c8-ba1a-2bfc2c0b2459 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1561 microversion: 2.1 time: 0.149074 Oct 28 09:52:39.746854 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 265/554] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:39 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:40.768612 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-0ee9e4b6-c84a-4bce-a016-bae439acaf61 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:40.769771 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-0ee9e4b6-c84a-4bce-a016-bae439acaf61 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:40.780568 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0ee9e4b6-c84a-4bce-a016-bae439acaf61 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:40.781043 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0ee9e4b6-c84a-4bce-a016-bae439acaf61 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:40.781816 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0ee9e4b6-c84a-4bce-a016-bae439acaf61 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:40.782247 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0ee9e4b6-c84a-4bce-a016-bae439acaf61 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:40.917324 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-0ee9e4b6-c84a-4bce-a016-bae439acaf61 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:40.926009 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-0ee9e4b6-c84a-4bce-a016-bae439acaf61 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1561 microversion: 2.1 time: 0.164523 Oct 28 09:52:40.926642 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 290/555] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:40 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:41.944800 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-0faf6f5c-48a6-428a-ac22-b1caf886c9ce tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:41.945484 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-0faf6f5c-48a6-428a-ac22-b1caf886c9ce tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:41.951934 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0faf6f5c-48a6-428a-ac22-b1caf886c9ce tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:41.952395 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0faf6f5c-48a6-428a-ac22-b1caf886c9ce tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:41.953226 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0faf6f5c-48a6-428a-ac22-b1caf886c9ce tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:41.953643 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0faf6f5c-48a6-428a-ac22-b1caf886c9ce tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:42.098336 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-0faf6f5c-48a6-428a-ac22-b1caf886c9ce tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:42.103755 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-0faf6f5c-48a6-428a-ac22-b1caf886c9ce tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1561 microversion: 2.1 time: 0.162608 Oct 28 09:52:42.104328 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 266/556] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:41 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:43.121906 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-4c9b7575-ae8b-4aa1-b96d-c598c5622d20 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:43.122573 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-4c9b7575-ae8b-4aa1-b96d-c598c5622d20 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:43.130188 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4c9b7575-ae8b-4aa1-b96d-c598c5622d20 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:43.130633 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4c9b7575-ae8b-4aa1-b96d-c598c5622d20 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:43.131663 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4c9b7575-ae8b-4aa1-b96d-c598c5622d20 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:43.132091 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4c9b7575-ae8b-4aa1-b96d-c598c5622d20 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:43.259390 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-4c9b7575-ae8b-4aa1-b96d-c598c5622d20 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:43.267703 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-4c9b7575-ae8b-4aa1-b96d-c598c5622d20 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1561 microversion: 2.1 time: 0.149977 Oct 28 09:52:43.268287 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 291/557] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:43 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:44.284786 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-0b0359af-8b3d-4714-94f9-8a3893fee58c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:44.285431 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-0b0359af-8b3d-4714-94f9-8a3893fee58c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:44.292683 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0b0359af-8b3d-4714-94f9-8a3893fee58c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:44.293214 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0b0359af-8b3d-4714-94f9-8a3893fee58c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:44.298864 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0b0359af-8b3d-4714-94f9-8a3893fee58c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:44.298864 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0b0359af-8b3d-4714-94f9-8a3893fee58c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:44.424998 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-0b0359af-8b3d-4714-94f9-8a3893fee58c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:44.434096 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-0b0359af-8b3d-4714-94f9-8a3893fee58c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1561 microversion: 2.1 time: 0.153139 Oct 28 09:52:44.434867 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 267/558] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:44 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:45.451619 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-9dc81899-5453-4542-b73c-15fb4623f1d5 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:45.452196 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-9dc81899-5453-4542-b73c-15fb4623f1d5 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:45.458579 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9dc81899-5453-4542-b73c-15fb4623f1d5 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:45.459014 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9dc81899-5453-4542-b73c-15fb4623f1d5 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:45.459781 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9dc81899-5453-4542-b73c-15fb4623f1d5 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:45.460350 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9dc81899-5453-4542-b73c-15fb4623f1d5 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:45.622888 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-9dc81899-5453-4542-b73c-15fb4623f1d5 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:45.632223 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-9dc81899-5453-4542-b73c-15fb4623f1d5 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1561 microversion: 2.1 time: 0.184164 Oct 28 09:52:45.642387 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 292/559] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:45 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1561 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:46.652124 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-f99ed8d6-f837-4bfa-b9d5-e539df0b7e1e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:46.652762 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-f99ed8d6-f837-4bfa-b9d5-e539df0b7e1e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:46.659162 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f99ed8d6-f837-4bfa-b9d5-e539df0b7e1e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:46.659617 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f99ed8d6-f837-4bfa-b9d5-e539df0b7e1e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:46.660399 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f99ed8d6-f837-4bfa-b9d5-e539df0b7e1e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:46.660871 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f99ed8d6-f837-4bfa-b9d5-e539df0b7e1e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:46.807024 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-f99ed8d6-f837-4bfa-b9d5-e539df0b7e1e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:46.816279 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-f99ed8d6-f837-4bfa-b9d5-e539df0b7e1e tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1567 microversion: 2.1 time: 0.169440 Oct 28 09:52:46.817212 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 268/560] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:46 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:46.933207 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-a479c466-dd2a-4300-af43-d9e59fb553a9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:46.933770 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-a479c466-dd2a-4300-af43-d9e59fb553a9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:46.941299 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a479c466-dd2a-4300-af43-d9e59fb553a9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:46.946659 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a479c466-dd2a-4300-af43-d9e59fb553a9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:46.946659 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a479c466-dd2a-4300-af43-d9e59fb553a9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:46.946659 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a479c466-dd2a-4300-af43-d9e59fb553a9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:47.114810 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.objects.instance [None req-a479c466-dd2a-4300-af43-d9e59fb553a9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lazy-loading 'services' on Instance uuid 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f {{(pid=123069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 09:52:47.417249 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-a479c466-dd2a-4300-af43-d9e59fb553a9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "DELETE /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f/os-volume_attachments/c3c0c6bc-ff53-496a-867d-e61518764421" status: 202 len: 0 microversion: 2.1 time: 0.487781 Oct 28 09:52:47.418113 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 293/561] 10.222.0.104 () {58 vars in 1420 bytes} [Thu Oct 28 09:52:46 2021] DELETE /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f/os-volume_attachments/c3c0c6bc-ff53-496a-867d-e61518764421 => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:52:47.436037 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-a9fafdf3-f67c-4f29-9d21-d4a1da224f0b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:47.437183 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-a9fafdf3-f67c-4f29-9d21-d4a1da224f0b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:47.444962 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a9fafdf3-f67c-4f29-9d21-d4a1da224f0b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:47.445405 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a9fafdf3-f67c-4f29-9d21-d4a1da224f0b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:47.447045 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a9fafdf3-f67c-4f29-9d21-d4a1da224f0b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:47.447767 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a9fafdf3-f67c-4f29-9d21-d4a1da224f0b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:47.482482 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-a9fafdf3-f67c-4f29-9d21-d4a1da224f0b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057449 Oct 28 09:52:47.483268 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 269/562] 10.222.0.104 () {58 vars in 1306 bytes} [Thu Oct 28 09:52:47 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:48.496328 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-bcb253c8-1e64-4943-af2b-7b5609456851 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:48.497543 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-bcb253c8-1e64-4943-af2b-7b5609456851 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:48.505561 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bcb253c8-1e64-4943-af2b-7b5609456851 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:48.506579 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bcb253c8-1e64-4943-af2b-7b5609456851 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:48.507735 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bcb253c8-1e64-4943-af2b-7b5609456851 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:48.508461 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bcb253c8-1e64-4943-af2b-7b5609456851 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:48.548746 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-35b47479-8a4b-41d5-9fd8-7503e2bd4e0a tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:48.550303 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-35b47479-8a4b-41d5-9fd8-7503e2bd4e0a tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:48.572570 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-35b47479-8a4b-41d5-9fd8-7503e2bd4e0a tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:48.574135 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-35b47479-8a4b-41d5-9fd8-7503e2bd4e0a tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:48.575010 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-35b47479-8a4b-41d5-9fd8-7503e2bd4e0a tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:48.575475 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-35b47479-8a4b-41d5-9fd8-7503e2bd4e0a tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:48.591512 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-bcb253c8-1e64-4943-af2b-7b5609456851 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100511 Oct 28 09:52:48.593048 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 294/563] 10.222.0.104 () {58 vars in 1306 bytes} [Thu Oct 28 09:52:48 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:48.823100 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-35b47479-8a4b-41d5-9fd8-7503e2bd4e0a tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "POST /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232/action" status: 202 len: 0 microversion: 2.1 time: 0.275945 Oct 28 09:52:48.823100 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 270/564] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:52:48 2021] POST /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 09:52:48.831726 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-fd30c93c-fd91-407e-a334-267fe7d446ca tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:48.832892 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-fd30c93c-fd91-407e-a334-267fe7d446ca tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:48.853044 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fd30c93c-fd91-407e-a334-267fe7d446ca tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:48.853895 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fd30c93c-fd91-407e-a334-267fe7d446ca tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:48.855446 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fd30c93c-fd91-407e-a334-267fe7d446ca tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:48.856073 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fd30c93c-fd91-407e-a334-267fe7d446ca tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:49.088283 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-fd30c93c-fd91-407e-a334-267fe7d446ca tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:49.100479 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-fd30c93c-fd91-407e-a334-267fe7d446ca tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1755 microversion: 2.1 time: 0.273154 Oct 28 09:52:49.105050 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 295/565] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:48 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1755 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:49.654529 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-62a18066-167c-4649-a047-5cfcef304d52 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:49.654529 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-62a18066-167c-4649-a047-5cfcef304d52 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:49.654529 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-62a18066-167c-4649-a047-5cfcef304d52 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:49.654529 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-62a18066-167c-4649-a047-5cfcef304d52 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:49.655782 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-62a18066-167c-4649-a047-5cfcef304d52 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:49.655782 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-62a18066-167c-4649-a047-5cfcef304d52 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:49.748220 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-62a18066-167c-4649-a047-5cfcef304d52 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.146413 Oct 28 09:52:49.750004 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 271/566] 10.222.0.104 () {58 vars in 1306 bytes} [Thu Oct 28 09:52:49 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f/os-volume_attachments => generated 25 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:52:50.127400 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-5e09d757-4986-46c6-8cad-539f486e2075 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:50.129025 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-5e09d757-4986-46c6-8cad-539f486e2075 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:50.145709 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5e09d757-4986-46c6-8cad-539f486e2075 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:50.151941 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5e09d757-4986-46c6-8cad-539f486e2075 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:50.151941 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5e09d757-4986-46c6-8cad-539f486e2075 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:50.160411 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5e09d757-4986-46c6-8cad-539f486e2075 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:50.361093 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-5e09d757-4986-46c6-8cad-539f486e2075 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:50.370017 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-5e09d757-4986-46c6-8cad-539f486e2075 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1760 microversion: 2.1 time: 0.250418 Oct 28 09:52:50.370718 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 296/567] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:50 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1760 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:51.389306 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-c394a8ab-804f-48af-b887-8cd123b6a130 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:51.390792 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-c394a8ab-804f-48af-b887-8cd123b6a130 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:51.397927 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c394a8ab-804f-48af-b887-8cd123b6a130 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:51.398716 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c394a8ab-804f-48af-b887-8cd123b6a130 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:51.400187 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c394a8ab-804f-48af-b887-8cd123b6a130 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:51.400630 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c394a8ab-804f-48af-b887-8cd123b6a130 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:51.595219 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-c394a8ab-804f-48af-b887-8cd123b6a130 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:51.604446 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-c394a8ab-804f-48af-b887-8cd123b6a130 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1760 microversion: 2.1 time: 0.219011 Oct 28 09:52:51.605049 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 272/568] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:51 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1760 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:52.593466 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-6ca62d37-2c01-4291-9cc6-9b9d0b0fb7cc tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:52.594907 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-6ca62d37-2c01-4291-9cc6-9b9d0b0fb7cc tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:52.601410 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6ca62d37-2c01-4291-9cc6-9b9d0b0fb7cc tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:52.601853 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6ca62d37-2c01-4291-9cc6-9b9d0b0fb7cc tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:52.603238 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6ca62d37-2c01-4291-9cc6-9b9d0b0fb7cc tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:52.603854 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6ca62d37-2c01-4291-9cc6-9b9d0b0fb7cc tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:52.622120 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-2a0f3595-ccea-455c-97a0-20fb6ccbb013 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:52.623785 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-2a0f3595-ccea-455c-97a0-20fb6ccbb013 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:52.634302 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2a0f3595-ccea-455c-97a0-20fb6ccbb013 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:52.635162 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2a0f3595-ccea-455c-97a0-20fb6ccbb013 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:52.636189 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2a0f3595-ccea-455c-97a0-20fb6ccbb013 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:52.636919 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2a0f3595-ccea-455c-97a0-20fb6ccbb013 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:52.638185 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-6ca62d37-2c01-4291-9cc6-9b9d0b0fb7cc tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Going to try to terminate instance {{(pid=123069) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 09:52:52.807678 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-2a0f3595-ccea-455c-97a0-20fb6ccbb013 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:52.817037 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-2a0f3595-ccea-455c-97a0-20fb6ccbb013 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1760 microversion: 2.1 time: 0.199110 Oct 28 09:52:52.817880 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 273/569] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:52 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1760 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:52:53.273611 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-6ca62d37-2c01-4291-9cc6-9b9d0b0fb7cc tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "DELETE /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 204 len: 0 microversion: 2.1 time: 0.683558 Oct 28 09:52:53.274612 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 297/570] 10.222.0.104 () {58 vars in 1243 bytes} [Thu Oct 28 09:52:52 2021] DELETE /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 0 bytes in 685 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:52:53.284222 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-82695819-b04e-479b-b5aa-34c238baed03 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:53.285138 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-82695819-b04e-479b-b5aa-34c238baed03 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:53.294603 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-82695819-b04e-479b-b5aa-34c238baed03 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:53.295206 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-82695819-b04e-479b-b5aa-34c238baed03 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:53.296943 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-82695819-b04e-479b-b5aa-34c238baed03 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:53.298069 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-82695819-b04e-479b-b5aa-34c238baed03 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:53.472292 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-82695819-b04e-479b-b5aa-34c238baed03 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:53.481136 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-82695819-b04e-479b-b5aa-34c238baed03 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1512 microversion: 2.1 time: 0.201552 Oct 28 09:52:53.481964 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 274/571] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:53 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1512 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:53.842809 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-e5320bdc-e7d2-4b21-80a9-3c37a866ca15 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:53.842809 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-e5320bdc-e7d2-4b21-80a9-3c37a866ca15 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:53.843758 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e5320bdc-e7d2-4b21-80a9-3c37a866ca15 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:53.844195 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e5320bdc-e7d2-4b21-80a9-3c37a866ca15 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:53.845003 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e5320bdc-e7d2-4b21-80a9-3c37a866ca15 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:53.845448 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e5320bdc-e7d2-4b21-80a9-3c37a866ca15 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:53.995291 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-e5320bdc-e7d2-4b21-80a9-3c37a866ca15 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:54.004356 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-e5320bdc-e7d2-4b21-80a9-3c37a866ca15 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1760 microversion: 2.1 time: 0.172542 Oct 28 09:52:54.014815 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 298/572] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:53 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1760 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:54.303683 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-12b2efd1-8f19-4e78-8c7c-a39e12d522cb tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-409129027", "imageRef": "623b30fc-1d92-46d9-b556-b9b963f3d76c", "flavorRef": "452"}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:54.398443 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.network.neutron [None req-12b2efd1-8f19-4e78-8c7c-a39e12d522cb tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] validate_networks() for None {{(pid=123068) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 09:52:54.498523 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-c83c5c78-b7b3-43d9-8336-bb710e16cf9d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:54.499505 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-c83c5c78-b7b3-43d9-8336-bb710e16cf9d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:54.514638 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c83c5c78-b7b3-43d9-8336-bb710e16cf9d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:54.515074 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c83c5c78-b7b3-43d9-8336-bb710e16cf9d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:54.516037 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c83c5c78-b7b3-43d9-8336-bb710e16cf9d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:54.516854 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c83c5c78-b7b3-43d9-8336-bb710e16cf9d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:54.850866 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-12b2efd1-8f19-4e78-8c7c-a39e12d522cb tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Flavor limits 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:52:54.851992 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-12b2efd1-8f19-4e78-8c7c-a39e12d522cb tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Image limits 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:52:54.853905 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-12b2efd1-8f19-4e78-8c7c-a39e12d522cb tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Flavor pref 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:52:54.855033 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-12b2efd1-8f19-4e78-8c7c-a39e12d522cb tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Image pref 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:52:54.856218 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-c83c5c78-b7b3-43d9-8336-bb710e16cf9d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:54.857072 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-12b2efd1-8f19-4e78-8c7c-a39e12d522cb tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:52:54.863743 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-c83c5c78-b7b3-43d9-8336-bb710e16cf9d tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1512 microversion: 2.1 time: 0.368789 Oct 28 09:52:54.864313 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 299/573] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:54 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1512 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:52:54.873623 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-12b2efd1-8f19-4e78-8c7c-a39e12d522cb tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:54.873623 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-12b2efd1-8f19-4e78-8c7c-a39e12d522cb tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:54.873623 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-12b2efd1-8f19-4e78-8c7c-a39e12d522cb tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:54.874058 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-12b2efd1-8f19-4e78-8c7c-a39e12d522cb tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:54.895887 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.quota [None req-12b2efd1-8f19-4e78-8c7c-a39e12d522cb tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Getting quotas for project 536d216676aa407f947e6a96788d6ae1. Resources: {'ram', 'cores', 'instances'} {{(pid=123068) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 09:52:54.900368 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.quota [None req-12b2efd1-8f19-4e78-8c7c-a39e12d522cb tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Getting quotas for user 4c20508e9de040b7a529cebb1c00947b and project 536d216676aa407f947e6a96788d6ae1. Resources: {'ram', 'cores', 'instances'} {{(pid=123068) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 09:52:54.911943 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-12b2efd1-8f19-4e78-8c7c-a39e12d522cb tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Going to run 1 instances... {{(pid=123068) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 09:52:54.914515 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-12b2efd1-8f19-4e78-8c7c-a39e12d522cb tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] [instance: f5c176dc-eadc-474f-9c63-b2d9326b5452] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='623b30fc-1d92-46d9-b556-b9b963f3d76c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 09:52:55.023575 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-15f34948-3f15-4e53-917a-fc9476bb1487 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:55.024946 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-15f34948-3f15-4e53-917a-fc9476bb1487 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:55.033021 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-15f34948-3f15-4e53-917a-fc9476bb1487 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:55.033479 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-15f34948-3f15-4e53-917a-fc9476bb1487 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:55.034380 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-15f34948-3f15-4e53-917a-fc9476bb1487 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:55.034805 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-15f34948-3f15-4e53-917a-fc9476bb1487 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:55.091500 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-12b2efd1-8f19-4e78-8c7c-a39e12d522cb tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] 10.222.0.104 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.792924 Oct 28 09:52:55.092035 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 275/574] 10.222.0.104 () {60 vars in 1151 bytes} [Thu Oct 28 09:52:54 2021] POST /compute/v2.1/servers => generated 382 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 28 09:52:55.103909 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-c1c293ea-1de9-4816-a7bc-1fe11a08cd7a tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:55.104773 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-c1c293ea-1de9-4816-a7bc-1fe11a08cd7a tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] [instance: f5c176dc-eadc-474f-9c63-b2d9326b5452] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:55.211692 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-c1c293ea-1de9-4816-a7bc-1fe11a08cd7a tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c20508e9de040b7a529cebb1c00947b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536d216676aa407f947e6a96788d6ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:55.229061 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-c1c293ea-1de9-4816-a7bc-1fe11a08cd7a tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] 10.222.0.104 "GET /compute/v2.1/servers/f5c176dc-eadc-474f-9c63-b2d9326b5452" status: 200 len: 1218 microversion: 2.1 time: 0.123724 Oct 28 09:52:55.229061 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 276/575] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:55 2021] GET /compute/v2.1/servers/f5c176dc-eadc-474f-9c63-b2d9326b5452 => generated 1218 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:55.349358 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-15f34948-3f15-4e53-917a-fc9476bb1487 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:55.374177 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-15f34948-3f15-4e53-917a-fc9476bb1487 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1760 microversion: 2.1 time: 0.354770 Oct 28 09:52:55.375430 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 300/576] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:55 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1760 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:55.883892 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-cd91c665-b38b-402f-980a-65a9f49f37be tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:55.884887 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-cd91c665-b38b-402f-980a-65a9f49f37be tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:55.893286 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cd91c665-b38b-402f-980a-65a9f49f37be tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:55.896534 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cd91c665-b38b-402f-980a-65a9f49f37be tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:55.896534 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cd91c665-b38b-402f-980a-65a9f49f37be tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:55.896534 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cd91c665-b38b-402f-980a-65a9f49f37be tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:56.057531 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-cd91c665-b38b-402f-980a-65a9f49f37be tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:56.067479 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-cd91c665-b38b-402f-980a-65a9f49f37be tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1512 microversion: 2.1 time: 0.188801 Oct 28 09:52:56.071527 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 277/577] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:55 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1512 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:56.244408 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-acd3eeb8-ffd1-4445-b9c3-c8ad15beba3c tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:56.245749 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-acd3eeb8-ffd1-4445-b9c3-c8ad15beba3c tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] [instance: f5c176dc-eadc-474f-9c63-b2d9326b5452] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:56.329748 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-acd3eeb8-ffd1-4445-b9c3-c8ad15beba3c tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c20508e9de040b7a529cebb1c00947b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536d216676aa407f947e6a96788d6ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:56.342757 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-acd3eeb8-ffd1-4445-b9c3-c8ad15beba3c tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] 10.222.0.104 "GET /compute/v2.1/servers/f5c176dc-eadc-474f-9c63-b2d9326b5452" status: 200 len: 1218 microversion: 2.1 time: 0.102140 Oct 28 09:52:56.344124 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 301/578] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:56 2021] GET /compute/v2.1/servers/f5c176dc-eadc-474f-9c63-b2d9326b5452 => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:56.392566 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-147e6183-2608-4f3a-bf87-95d99ae8ad53 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:56.393636 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-147e6183-2608-4f3a-bf87-95d99ae8ad53 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:56.401424 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-147e6183-2608-4f3a-bf87-95d99ae8ad53 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:56.402422 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-147e6183-2608-4f3a-bf87-95d99ae8ad53 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:56.402679 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-147e6183-2608-4f3a-bf87-95d99ae8ad53 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:56.403348 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-147e6183-2608-4f3a-bf87-95d99ae8ad53 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:56.585397 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-147e6183-2608-4f3a-bf87-95d99ae8ad53 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:56.598420 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-147e6183-2608-4f3a-bf87-95d99ae8ad53 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1760 microversion: 2.1 time: 0.209254 Oct 28 09:52:56.599216 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 278/579] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:56 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1760 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:57.091335 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-6bc6d25b-c985-4416-9d18-68a601bdd315 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:57.095917 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-6bc6d25b-c985-4416-9d18-68a601bdd315 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:57.115495 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6bc6d25b-c985-4416-9d18-68a601bdd315 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:57.115495 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6bc6d25b-c985-4416-9d18-68a601bdd315 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:57.119924 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6bc6d25b-c985-4416-9d18-68a601bdd315 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:57.120905 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6bc6d25b-c985-4416-9d18-68a601bdd315 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:57.340564 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-6bc6d25b-c985-4416-9d18-68a601bdd315 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:57.350008 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-6bc6d25b-c985-4416-9d18-68a601bdd315 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1512 microversion: 2.1 time: 0.269042 Oct 28 09:52:57.361680 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 302/580] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:57 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1512 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:57.373308 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-ab5e8ec1-eb16-4ae8-9293-7aa5d0cc9997 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:57.374947 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-ab5e8ec1-eb16-4ae8-9293-7aa5d0cc9997 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] [instance: f5c176dc-eadc-474f-9c63-b2d9326b5452] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:57.385067 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ab5e8ec1-eb16-4ae8-9293-7aa5d0cc9997 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:57.386241 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ab5e8ec1-eb16-4ae8-9293-7aa5d0cc9997 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:57.388193 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ab5e8ec1-eb16-4ae8-9293-7aa5d0cc9997 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:57.389277 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ab5e8ec1-eb16-4ae8-9293-7aa5d0cc9997 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:57.503340 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-ab5e8ec1-eb16-4ae8-9293-7aa5d0cc9997 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c20508e9de040b7a529cebb1c00947b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536d216676aa407f947e6a96788d6ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:57.522829 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-ab5e8ec1-eb16-4ae8-9293-7aa5d0cc9997 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] 10.222.0.104 "GET /compute/v2.1/servers/f5c176dc-eadc-474f-9c63-b2d9326b5452" status: 200 len: 1270 microversion: 2.1 time: 0.157275 Oct 28 09:52:57.540940 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 279/581] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:57 2021] GET /compute/v2.1/servers/f5c176dc-eadc-474f-9c63-b2d9326b5452 => generated 1270 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:57.623143 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-fea895a0-c139-430b-bda8-b732819295b0 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:57.624334 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-fea895a0-c139-430b-bda8-b732819295b0 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:57.641917 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fea895a0-c139-430b-bda8-b732819295b0 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:57.642339 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fea895a0-c139-430b-bda8-b732819295b0 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:57.644126 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fea895a0-c139-430b-bda8-b732819295b0 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:57.644868 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fea895a0-c139-430b-bda8-b732819295b0 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:57.808119 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-b3995e1e-8482-4228-bfa6-2e7c6b4aca0d req-d089cfd5-3dbb-4967-9e0a-15975c6d7c88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92c11d42-a056-41fa-a849-4e40e7c6d22e", "name": "network-vif-deleted", "tag": "57d63798-5c66-4f30-9d4a-de7a6ff1392d"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:57.810925 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:52:57.810925 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:52:57.827928 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-b3995e1e-8482-4228-bfa6-2e7c6b4aca0d req-d089cfd5-3dbb-4967-9e0a-15975c6d7c88 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:57.828644 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-b3995e1e-8482-4228-bfa6-2e7c6b4aca0d req-d089cfd5-3dbb-4967-9e0a-15975c6d7c88 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:57.850889 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-b3995e1e-8482-4228-bfa6-2e7c6b4aca0d req-d089cfd5-3dbb-4967-9e0a-15975c6d7c88 service nova] Creating event network-vif-deleted:57d63798-5c66-4f30-9d4a-de7a6ff1392d for instance 92c11d42-a056-41fa-a849-4e40e7c6d22e on hv-cinder-81571 Oct 28 09:52:57.863356 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-b3995e1e-8482-4228-bfa6-2e7c6b4aca0d req-d089cfd5-3dbb-4967-9e0a-15975c6d7c88 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061645 Oct 28 09:52:57.865061 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 280/582] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:52:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:52:57.967363 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-fea895a0-c139-430b-bda8-b732819295b0 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:57.979900 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-fea895a0-c139-430b-bda8-b732819295b0 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1760 microversion: 2.1 time: 0.365399 Oct 28 09:52:57.998025 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 303/583] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:57 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1760 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:58.382279 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-4bb1ec9c-2f7d-4563-99f2-fb6f8225c3ef tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:58.388569 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-4bb1ec9c-2f7d-4563-99f2-fb6f8225c3ef tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:58.407422 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4bb1ec9c-2f7d-4563-99f2-fb6f8225c3ef tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:58.408196 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4bb1ec9c-2f7d-4563-99f2-fb6f8225c3ef tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:58.409017 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4bb1ec9c-2f7d-4563-99f2-fb6f8225c3ef tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:58.409627 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4bb1ec9c-2f7d-4563-99f2-fb6f8225c3ef tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:58.460274 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4bb1ec9c-2f7d-4563-99f2-fb6f8225c3ef tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:58.460274 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4bb1ec9c-2f7d-4563-99f2-fb6f8225c3ef tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:58.460274 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.objects.instance [None req-4bb1ec9c-2f7d-4563-99f2-fb6f8225c3ef tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lazy-loading 'fault' on Instance uuid 92c11d42-a056-41fa-a849-4e40e7c6d22e {{(pid=123068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 09:52:58.527291 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-4bb1ec9c-2f7d-4563-99f2-fb6f8225c3ef tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:58.537148 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-4bb1ec9c-2f7d-4563-99f2-fb6f8225c3ef tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 200 len: 1315 microversion: 2.1 time: 0.165764 Oct 28 09:52:58.542796 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 281/584] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:58 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:52:58.565988 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-82c322a7-22eb-490a-a5b8-5594d4b655b0 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:58.566821 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-82c322a7-22eb-490a-a5b8-5594d4b655b0 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] [instance: f5c176dc-eadc-474f-9c63-b2d9326b5452] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:58.574624 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-82c322a7-22eb-490a-a5b8-5594d4b655b0 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:58.575416 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-82c322a7-22eb-490a-a5b8-5594d4b655b0 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:58.576195 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-82c322a7-22eb-490a-a5b8-5594d4b655b0 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:58.576966 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-82c322a7-22eb-490a-a5b8-5594d4b655b0 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:58.658880 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-82c322a7-22eb-490a-a5b8-5594d4b655b0 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c20508e9de040b7a529cebb1c00947b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536d216676aa407f947e6a96788d6ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:58.669756 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-82c322a7-22eb-490a-a5b8-5594d4b655b0 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] 10.222.0.104 "GET /compute/v2.1/servers/f5c176dc-eadc-474f-9c63-b2d9326b5452" status: 200 len: 1276 microversion: 2.1 time: 0.111193 Oct 28 09:52:58.674590 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 304/585] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:58 2021] GET /compute/v2.1/servers/f5c176dc-eadc-474f-9c63-b2d9326b5452 => generated 1276 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:59.006614 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-07489028-8623-4703-a72c-a3c12e317fa4 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:59.008250 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-07489028-8623-4703-a72c-a3c12e317fa4 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:59.020173 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-07489028-8623-4703-a72c-a3c12e317fa4 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:59.021390 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-07489028-8623-4703-a72c-a3c12e317fa4 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:59.023087 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-07489028-8623-4703-a72c-a3c12e317fa4 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:59.024160 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-07489028-8623-4703-a72c-a3c12e317fa4 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:59.261036 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-07489028-8623-4703-a72c-a3c12e317fa4 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:59.276200 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-07489028-8623-4703-a72c-a3c12e317fa4 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1760 microversion: 2.1 time: 0.276704 Oct 28 09:52:59.277103 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 282/586] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:58 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1760 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:52:59.559453 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-d35c2109-5671-4fe9-838d-fd1728f7843c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:59.560095 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-d35c2109-5671-4fe9-838d-fd1728f7843c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 92c11d42-a056-41fa-a849-4e40e7c6d22e] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:59.566043 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d35c2109-5671-4fe9-838d-fd1728f7843c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:59.566619 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d35c2109-5671-4fe9-838d-fd1728f7843c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:59.567450 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d35c2109-5671-4fe9-838d-fd1728f7843c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:59.567930 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d35c2109-5671-4fe9-838d-fd1728f7843c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:59.585536 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.wsgi [None req-d35c2109-5671-4fe9-838d-fd1728f7843c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] HTTP exception thrown: Instance 92c11d42-a056-41fa-a849-4e40e7c6d22e could not be found. Oct 28 09:52:59.586232 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-d35c2109-5671-4fe9-838d-fd1728f7843c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Returning 404 to user: Instance 92c11d42-a056-41fa-a849-4e40e7c6d22e could not be found. {{(pid=123069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:52:59.587645 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-d35c2109-5671-4fe9-838d-fd1728f7843c tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e" status: 404 len: 111 microversion: 2.1 time: 0.032604 Oct 28 09:52:59.588187 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 305/587] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:59 2021] GET /compute/v2.1/servers/92c11d42-a056-41fa-a849-4e40e7c6d22e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:52:59.602519 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-0214892d-a474-42be-a036-1a0f8d49ae6b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:59.603148 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-0214892d-a474-42be-a036-1a0f8d49ae6b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:59.609164 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0214892d-a474-42be-a036-1a0f8d49ae6b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:59.609607 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0214892d-a474-42be-a036-1a0f8d49ae6b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:59.610369 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0214892d-a474-42be-a036-1a0f8d49ae6b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:59.611160 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0214892d-a474-42be-a036-1a0f8d49ae6b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:59.641475 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-0214892d-a474-42be-a036-1a0f8d49ae6b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Going to try to terminate instance {{(pid=123068) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 09:52:59.692464 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-2e742bfb-927c-4503-bba3-be42658a8449 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:59.692464 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-2e742bfb-927c-4503-bba3-be42658a8449 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] [instance: f5c176dc-eadc-474f-9c63-b2d9326b5452] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:52:59.748391 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2e742bfb-927c-4503-bba3-be42658a8449 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:59.748875 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2e742bfb-927c-4503-bba3-be42658a8449 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:59.749669 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2e742bfb-927c-4503-bba3-be42658a8449 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:52:59.750097 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2e742bfb-927c-4503-bba3-be42658a8449 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:52:59.956338 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-2e742bfb-927c-4503-bba3-be42658a8449 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c20508e9de040b7a529cebb1c00947b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536d216676aa407f947e6a96788d6ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:59.972524 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-2e742bfb-927c-4503-bba3-be42658a8449 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] 10.222.0.104 "GET /compute/v2.1/servers/f5c176dc-eadc-474f-9c63-b2d9326b5452" status: 200 len: 1318 microversion: 2.1 time: 0.286367 Oct 28 09:52:59.974526 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 306/588] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:52:59 2021] GET /compute/v2.1/servers/f5c176dc-eadc-474f-9c63-b2d9326b5452 => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:53:00.044598 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-0214892d-a474-42be-a036-1a0f8d49ae6b tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "DELETE /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 204 len: 0 microversion: 2.1 time: 0.445394 Oct 28 09:53:00.048132 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 283/589] 10.222.0.104 () {58 vars in 1243 bytes} [Thu Oct 28 09:52:59 2021] DELETE /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:53:00.056569 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-5cb8e7fc-ac47-4540-80a4-2fe25e7cef31 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:00.060212 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-5cb8e7fc-ac47-4540-80a4-2fe25e7cef31 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:00.065055 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5cb8e7fc-ac47-4540-80a4-2fe25e7cef31 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:00.065743 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5cb8e7fc-ac47-4540-80a4-2fe25e7cef31 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:00.066857 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5cb8e7fc-ac47-4540-80a4-2fe25e7cef31 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:00.067320 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5cb8e7fc-ac47-4540-80a4-2fe25e7cef31 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:00.297287 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-1b406083-6289-4e9d-8951-6884bf777aec tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:00.298970 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-1b406083-6289-4e9d-8951-6884bf777aec tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:00.309829 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1b406083-6289-4e9d-8951-6884bf777aec tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:00.313349 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1b406083-6289-4e9d-8951-6884bf777aec tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:00.316193 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1b406083-6289-4e9d-8951-6884bf777aec tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:00.316917 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1b406083-6289-4e9d-8951-6884bf777aec tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:00.333794 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-5cb8e7fc-ac47-4540-80a4-2fe25e7cef31 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:00.343531 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-5cb8e7fc-ac47-4540-80a4-2fe25e7cef31 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1527 microversion: 2.1 time: 0.292264 Oct 28 09:53:00.353347 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 307/590] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:00 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1527 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:00.500336 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-1b406083-6289-4e9d-8951-6884bf777aec tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:00.527011 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-1b406083-6289-4e9d-8951-6884bf777aec tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1760 microversion: 2.1 time: 0.233885 Oct 28 09:53:00.527570 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 284/591] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:00 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1760 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:00.986616 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [req-c58ae932-b581-45fa-96ce-0f4389799fb3 req-790c2a53-ac01-494b-870e-20942ca283a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5c176dc-eadc-474f-9c63-b2d9326b5452", "tag": "6d789963-66cb-4e9a-97f8-5e3ca3ee7e4d"}]} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:00.988218 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:53:00.988218 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 09:53:00.999371 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-c58ae932-b581-45fa-96ce-0f4389799fb3 req-790c2a53-ac01-494b-870e-20942ca283a7 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:00.999822 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-c58ae932-b581-45fa-96ce-0f4389799fb3 req-790c2a53-ac01-494b-870e-20942ca283a7 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:01.005953 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-19d3ff69-1c68-4116-bd05-a7d30eabd2ab tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:01.007224 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-19d3ff69-1c68-4116-bd05-a7d30eabd2ab tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] [instance: f5c176dc-eadc-474f-9c63-b2d9326b5452] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:01.017753 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-19d3ff69-1c68-4116-bd05-a7d30eabd2ab tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:01.017753 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-19d3ff69-1c68-4116-bd05-a7d30eabd2ab tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:01.017753 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-19d3ff69-1c68-4116-bd05-a7d30eabd2ab tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:01.017753 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-19d3ff69-1c68-4116-bd05-a7d30eabd2ab tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:01.049369 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.compute.server_external_events [req-c58ae932-b581-45fa-96ce-0f4389799fb3 req-790c2a53-ac01-494b-870e-20942ca283a7 service nova] Creating event network-changed:6d789963-66cb-4e9a-97f8-5e3ca3ee7e4d for instance f5c176dc-eadc-474f-9c63-b2d9326b5452 on hv-cinder-81571 Oct 28 09:53:01.069255 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [req-c58ae932-b581-45fa-96ce-0f4389799fb3 req-790c2a53-ac01-494b-870e-20942ca283a7 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085043 Oct 28 09:53:01.072564 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 308/592] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:53:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:01.253982 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-19d3ff69-1c68-4116-bd05-a7d30eabd2ab tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c20508e9de040b7a529cebb1c00947b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536d216676aa407f947e6a96788d6ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:01.263406 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-19d3ff69-1c68-4116-bd05-a7d30eabd2ab tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] 10.222.0.104 "GET /compute/v2.1/servers/f5c176dc-eadc-474f-9c63-b2d9326b5452" status: 200 len: 1318 microversion: 2.1 time: 0.261977 Oct 28 09:53:01.274260 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 285/593] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:01 2021] GET /compute/v2.1/servers/f5c176dc-eadc-474f-9c63-b2d9326b5452 => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:01.366334 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-519cdbea-4ac4-446f-a662-263d63d78c83 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:01.367045 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-519cdbea-4ac4-446f-a662-263d63d78c83 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:01.376978 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-519cdbea-4ac4-446f-a662-263d63d78c83 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:01.377420 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-519cdbea-4ac4-446f-a662-263d63d78c83 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:01.379934 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-519cdbea-4ac4-446f-a662-263d63d78c83 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:01.380830 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-519cdbea-4ac4-446f-a662-263d63d78c83 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:01.578776 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-073a5624-3310-49c5-b0d3-00e8d48a102f tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:01.579875 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-073a5624-3310-49c5-b0d3-00e8d48a102f tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:01.590248 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-073a5624-3310-49c5-b0d3-00e8d48a102f tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:01.591180 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-073a5624-3310-49c5-b0d3-00e8d48a102f tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:01.592591 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-073a5624-3310-49c5-b0d3-00e8d48a102f tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:01.593549 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-073a5624-3310-49c5-b0d3-00e8d48a102f tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:01.602355 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-519cdbea-4ac4-446f-a662-263d63d78c83 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:01.619480 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-519cdbea-4ac4-446f-a662-263d63d78c83 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1527 microversion: 2.1 time: 0.257028 Oct 28 09:53:01.621008 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 309/594] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:01 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1527 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:01.812135 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-073a5624-3310-49c5-b0d3-00e8d48a102f tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:01.829853 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-073a5624-3310-49c5-b0d3-00e8d48a102f tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1760 microversion: 2.1 time: 0.259331 Oct 28 09:53:01.830718 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 286/595] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:01 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1760 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:02.284529 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-077cb29a-48c4-4432-8335-ceea092b47cb tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:02.286586 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-077cb29a-48c4-4432-8335-ceea092b47cb tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] [instance: f5c176dc-eadc-474f-9c63-b2d9326b5452] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:02.297448 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-077cb29a-48c4-4432-8335-ceea092b47cb tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:02.298582 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-077cb29a-48c4-4432-8335-ceea092b47cb tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:02.300150 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-077cb29a-48c4-4432-8335-ceea092b47cb tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:02.300754 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-077cb29a-48c4-4432-8335-ceea092b47cb tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:02.483220 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-077cb29a-48c4-4432-8335-ceea092b47cb tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c20508e9de040b7a529cebb1c00947b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536d216676aa407f947e6a96788d6ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:02.495116 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-077cb29a-48c4-4432-8335-ceea092b47cb tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] 10.222.0.104 "GET /compute/v2.1/servers/f5c176dc-eadc-474f-9c63-b2d9326b5452" status: 200 len: 1318 microversion: 2.1 time: 0.216235 Oct 28 09:53:02.496426 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 310/596] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:02 2021] GET /compute/v2.1/servers/f5c176dc-eadc-474f-9c63-b2d9326b5452 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:02.648572 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-db626757-ef28-40a7-b519-6c4b37338395 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:02.650053 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-db626757-ef28-40a7-b519-6c4b37338395 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:02.657895 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-db626757-ef28-40a7-b519-6c4b37338395 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:02.658935 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-db626757-ef28-40a7-b519-6c4b37338395 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:02.660059 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-db626757-ef28-40a7-b519-6c4b37338395 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:02.660993 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-db626757-ef28-40a7-b519-6c4b37338395 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:02.829603 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-db626757-ef28-40a7-b519-6c4b37338395 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:02.843782 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-db626757-ef28-40a7-b519-6c4b37338395 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1527 microversion: 2.1 time: 0.203831 Oct 28 09:53:02.844553 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 287/597] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:02 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1527 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:02.848322 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-41ad32f9-390d-416d-9fb5-980c3fc9a134 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:02.848958 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-41ad32f9-390d-416d-9fb5-980c3fc9a134 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:02.858656 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-41ad32f9-390d-416d-9fb5-980c3fc9a134 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:02.859093 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-41ad32f9-390d-416d-9fb5-980c3fc9a134 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:02.859916 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-41ad32f9-390d-416d-9fb5-980c3fc9a134 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:02.860340 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-41ad32f9-390d-416d-9fb5-980c3fc9a134 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:03.029694 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-41ad32f9-390d-416d-9fb5-980c3fc9a134 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:03.040336 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-41ad32f9-390d-416d-9fb5-980c3fc9a134 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1760 microversion: 2.1 time: 0.195378 Oct 28 09:53:03.041352 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 311/598] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:02 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1760 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:53:03.512323 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-fe2132a8-a7c5-4032-90a4-9964fb5df5c0 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:03.512978 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-fe2132a8-a7c5-4032-90a4-9964fb5df5c0 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] [instance: f5c176dc-eadc-474f-9c63-b2d9326b5452] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:03.518987 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fe2132a8-a7c5-4032-90a4-9964fb5df5c0 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:03.519434 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fe2132a8-a7c5-4032-90a4-9964fb5df5c0 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:03.520209 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fe2132a8-a7c5-4032-90a4-9964fb5df5c0 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:03.520637 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fe2132a8-a7c5-4032-90a4-9964fb5df5c0 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:03.663173 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-fe2132a8-a7c5-4032-90a4-9964fb5df5c0 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c20508e9de040b7a529cebb1c00947b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536d216676aa407f947e6a96788d6ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:03.678852 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-fe2132a8-a7c5-4032-90a4-9964fb5df5c0 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] 10.222.0.104 "GET /compute/v2.1/servers/f5c176dc-eadc-474f-9c63-b2d9326b5452" status: 200 len: 1318 microversion: 2.1 time: 0.170664 Oct 28 09:53:03.691903 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 288/599] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:03 2021] GET /compute/v2.1/servers/f5c176dc-eadc-474f-9c63-b2d9326b5452 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:03.863649 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-b757c254-d4bb-4939-8cd4-cefcf722a9d3 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:03.865080 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-b757c254-d4bb-4939-8cd4-cefcf722a9d3 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:03.873834 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b757c254-d4bb-4939-8cd4-cefcf722a9d3 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:03.874521 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b757c254-d4bb-4939-8cd4-cefcf722a9d3 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:03.875475 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b757c254-d4bb-4939-8cd4-cefcf722a9d3 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:03.876059 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b757c254-d4bb-4939-8cd4-cefcf722a9d3 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:04.030408 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-b757c254-d4bb-4939-8cd4-cefcf722a9d3 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:04.039252 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-b757c254-d4bb-4939-8cd4-cefcf722a9d3 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1527 microversion: 2.1 time: 0.179499 Oct 28 09:53:04.040732 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 312/600] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:03 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1527 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:04.059290 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-f5c1d4de-e48c-43e9-9c42-4439d4be27cf tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:04.063922 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-f5c1d4de-e48c-43e9-9c42-4439d4be27cf tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:04.069814 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f5c1d4de-e48c-43e9-9c42-4439d4be27cf tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:04.071532 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f5c1d4de-e48c-43e9-9c42-4439d4be27cf tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:04.072561 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f5c1d4de-e48c-43e9-9c42-4439d4be27cf tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:04.073010 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f5c1d4de-e48c-43e9-9c42-4439d4be27cf tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:04.227253 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-f5c1d4de-e48c-43e9-9c42-4439d4be27cf tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:04.236179 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-f5c1d4de-e48c-43e9-9c42-4439d4be27cf tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1760 microversion: 2.1 time: 0.181514 Oct 28 09:53:04.236787 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 289/601] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:04 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1760 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:53:04.698781 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-b5674258-2d12-4677-a583-773a0a065071 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:04.699488 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-b5674258-2d12-4677-a583-773a0a065071 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] [instance: f5c176dc-eadc-474f-9c63-b2d9326b5452] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:04.705914 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b5674258-2d12-4677-a583-773a0a065071 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:04.706417 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b5674258-2d12-4677-a583-773a0a065071 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:04.707345 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b5674258-2d12-4677-a583-773a0a065071 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:04.707830 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b5674258-2d12-4677-a583-773a0a065071 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:04.847306 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-b5674258-2d12-4677-a583-773a0a065071 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c20508e9de040b7a529cebb1c00947b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536d216676aa407f947e6a96788d6ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:04.855671 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-b5674258-2d12-4677-a583-773a0a065071 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] 10.222.0.104 "GET /compute/v2.1/servers/f5c176dc-eadc-474f-9c63-b2d9326b5452" status: 200 len: 1318 microversion: 2.1 time: 0.160484 Oct 28 09:53:04.856239 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 313/602] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:04 2021] GET /compute/v2.1/servers/f5c176dc-eadc-474f-9c63-b2d9326b5452 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:05.057191 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-a24fd295-5a26-4f2d-b8d9-74821da169a2 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:05.057791 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-a24fd295-5a26-4f2d-b8d9-74821da169a2 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:05.064113 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a24fd295-5a26-4f2d-b8d9-74821da169a2 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:05.064561 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a24fd295-5a26-4f2d-b8d9-74821da169a2 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:05.065397 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a24fd295-5a26-4f2d-b8d9-74821da169a2 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:05.065832 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a24fd295-5a26-4f2d-b8d9-74821da169a2 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:05.193195 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-a24fd295-5a26-4f2d-b8d9-74821da169a2 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:05.200932 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-a24fd295-5a26-4f2d-b8d9-74821da169a2 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1527 microversion: 2.1 time: 0.148075 Oct 28 09:53:05.201499 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 290/603] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:05 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1527 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:05.253387 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-f6275912-0ea8-412f-b075-23f571c3c007 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:05.254035 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-f6275912-0ea8-412f-b075-23f571c3c007 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:05.261201 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f6275912-0ea8-412f-b075-23f571c3c007 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:05.261577 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f6275912-0ea8-412f-b075-23f571c3c007 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:05.262382 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f6275912-0ea8-412f-b075-23f571c3c007 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:05.262809 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f6275912-0ea8-412f-b075-23f571c3c007 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:05.403513 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-f6275912-0ea8-412f-b075-23f571c3c007 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:05.412063 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-f6275912-0ea8-412f-b075-23f571c3c007 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1760 microversion: 2.1 time: 0.162348 Oct 28 09:53:05.412771 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 314/604] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:05 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1760 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:05.873282 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-094dae68-b625-47b5-b578-c91ae2cf9389 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:05.873863 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-094dae68-b625-47b5-b578-c91ae2cf9389 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] [instance: f5c176dc-eadc-474f-9c63-b2d9326b5452] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:05.879746 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-094dae68-b625-47b5-b578-c91ae2cf9389 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:05.880175 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-094dae68-b625-47b5-b578-c91ae2cf9389 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:05.881235 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-094dae68-b625-47b5-b578-c91ae2cf9389 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:05.881668 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-094dae68-b625-47b5-b578-c91ae2cf9389 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:06.013209 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-094dae68-b625-47b5-b578-c91ae2cf9389 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c20508e9de040b7a529cebb1c00947b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536d216676aa407f947e6a96788d6ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:06.020527 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-094dae68-b625-47b5-b578-c91ae2cf9389 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] 10.222.0.104 "GET /compute/v2.1/servers/f5c176dc-eadc-474f-9c63-b2d9326b5452" status: 200 len: 1318 microversion: 2.1 time: 0.150846 Oct 28 09:53:06.021087 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 291/605] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:05 2021] GET /compute/v2.1/servers/f5c176dc-eadc-474f-9c63-b2d9326b5452 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:06.217670 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-ff12ec50-e02e-4911-b51e-27a1423cf8d7 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:06.218300 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-ff12ec50-e02e-4911-b51e-27a1423cf8d7 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:06.224367 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ff12ec50-e02e-4911-b51e-27a1423cf8d7 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:06.224918 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ff12ec50-e02e-4911-b51e-27a1423cf8d7 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:06.225706 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ff12ec50-e02e-4911-b51e-27a1423cf8d7 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:06.226136 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ff12ec50-e02e-4911-b51e-27a1423cf8d7 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:06.352458 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-ff12ec50-e02e-4911-b51e-27a1423cf8d7 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:06.360031 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-ff12ec50-e02e-4911-b51e-27a1423cf8d7 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1527 microversion: 2.1 time: 0.146042 Oct 28 09:53:06.360597 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 315/606] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:06 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1527 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:06.416045 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-82f4bda1-dcda-4bde-a2c7-5c3c7680773c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:06.418813 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-82f4bda1-dcda-4bde-a2c7-5c3c7680773c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:06.423599 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-82f4bda1-dcda-4bde-a2c7-5c3c7680773c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:06.424036 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-82f4bda1-dcda-4bde-a2c7-5c3c7680773c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:06.425482 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-82f4bda1-dcda-4bde-a2c7-5c3c7680773c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:06.425482 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-82f4bda1-dcda-4bde-a2c7-5c3c7680773c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:06.431658 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-bc941f5f-05dd-4f42-9307-69dfc568d872 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:06.432306 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-bc941f5f-05dd-4f42-9307-69dfc568d872 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:06.438079 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bc941f5f-05dd-4f42-9307-69dfc568d872 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:06.444003 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bc941f5f-05dd-4f42-9307-69dfc568d872 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:06.444003 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bc941f5f-05dd-4f42-9307-69dfc568d872 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:06.444003 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bc941f5f-05dd-4f42-9307-69dfc568d872 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:06.457589 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-82f4bda1-dcda-4bde-a2c7-5c3c7680773c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046014 Oct 28 09:53:06.458356 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 292/607] 10.222.0.104 () {58 vars in 1306 bytes} [Thu Oct 28 09:53:06 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:53:06.523120 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-1dfe2f19-3796-4d6b-857e-5c8124c20277 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:06.523706 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-1dfe2f19-3796-4d6b-857e-5c8124c20277 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:06.529815 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1dfe2f19-3796-4d6b-857e-5c8124c20277 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:06.530292 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1dfe2f19-3796-4d6b-857e-5c8124c20277 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:06.531069 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1dfe2f19-3796-4d6b-857e-5c8124c20277 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:06.531494 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1dfe2f19-3796-4d6b-857e-5c8124c20277 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:06.560912 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-1dfe2f19-3796-4d6b-857e-5c8124c20277 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Going to try to terminate instance {{(pid=123068) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 09:53:06.587565 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-bc941f5f-05dd-4f42-9307-69dfc568d872 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:06.604119 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-bc941f5f-05dd-4f42-9307-69dfc568d872 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1760 microversion: 2.1 time: 0.176551 Oct 28 09:53:06.605223 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 316/608] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:06 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1760 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:53:06.845272 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-1dfe2f19-3796-4d6b-857e-5c8124c20277 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "DELETE /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 204 len: 0 microversion: 2.1 time: 0.325127 Oct 28 09:53:06.845980 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 293/609] 10.222.0.104 () {58 vars in 1243 bytes} [Thu Oct 28 09:53:06 2021] DELETE /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:53:06.858113 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-5417510c-6089-43f1-a089-ff639ad8081f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:06.860248 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-5417510c-6089-43f1-a089-ff639ad8081f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:06.866791 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5417510c-6089-43f1-a089-ff639ad8081f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:06.867412 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5417510c-6089-43f1-a089-ff639ad8081f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:06.868461 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5417510c-6089-43f1-a089-ff639ad8081f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:06.868881 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5417510c-6089-43f1-a089-ff639ad8081f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:07.003131 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-5417510c-6089-43f1-a089-ff639ad8081f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:07.010840 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-5417510c-6089-43f1-a089-ff639ad8081f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1677 microversion: 2.1 time: 0.160462 Oct 28 09:53:07.011415 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 317/610] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:06 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:07.037918 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-645dc031-ce6d-46ca-8e92-0b82ccec6c91 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:07.038612 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-645dc031-ce6d-46ca-8e92-0b82ccec6c91 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] [instance: f5c176dc-eadc-474f-9c63-b2d9326b5452] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:07.045393 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-645dc031-ce6d-46ca-8e92-0b82ccec6c91 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:07.045830 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-645dc031-ce6d-46ca-8e92-0b82ccec6c91 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:07.046634 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-645dc031-ce6d-46ca-8e92-0b82ccec6c91 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:07.047025 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-645dc031-ce6d-46ca-8e92-0b82ccec6c91 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:07.081832 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [req-4cb5f5fb-0087-4534-baa6-efad226afc3a req-0fa1fd2d-155f-4bc7-b4dc-ec03d2388938 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5c176dc-eadc-474f-9c63-b2d9326b5452", "name": "network-vif-plugged", "status": "completed", "tag": "6d789963-66cb-4e9a-97f8-5e3ca3ee7e4d"}]} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:07.086860 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:53:07.086860 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 09:53:07.091106 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-4cb5f5fb-0087-4534-baa6-efad226afc3a req-0fa1fd2d-155f-4bc7-b4dc-ec03d2388938 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:07.091545 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-4cb5f5fb-0087-4534-baa6-efad226afc3a req-0fa1fd2d-155f-4bc7-b4dc-ec03d2388938 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:07.103767 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.compute.server_external_events [req-4cb5f5fb-0087-4534-baa6-efad226afc3a req-0fa1fd2d-155f-4bc7-b4dc-ec03d2388938 service nova] Creating event network-vif-plugged:6d789963-66cb-4e9a-97f8-5e3ca3ee7e4d for instance f5c176dc-eadc-474f-9c63-b2d9326b5452 on hv-cinder-81571 Oct 28 09:53:07.108981 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [req-4cb5f5fb-0087-4534-baa6-efad226afc3a req-0fa1fd2d-155f-4bc7-b4dc-ec03d2388938 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030637 Oct 28 09:53:07.110451 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 318/611] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:53:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:53:07.183558 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-645dc031-ce6d-46ca-8e92-0b82ccec6c91 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c20508e9de040b7a529cebb1c00947b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536d216676aa407f947e6a96788d6ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:07.191833 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-645dc031-ce6d-46ca-8e92-0b82ccec6c91 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] 10.222.0.104 "GET /compute/v2.1/servers/f5c176dc-eadc-474f-9c63-b2d9326b5452" status: 200 len: 1318 microversion: 2.1 time: 0.157984 Oct 28 09:53:07.192416 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 294/612] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:07 2021] GET /compute/v2.1/servers/f5c176dc-eadc-474f-9c63-b2d9326b5452 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:07.378326 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-aaae4706-f75e-4f3a-a683-83d6780ec9d9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:07.379160 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-aaae4706-f75e-4f3a-a683-83d6780ec9d9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:07.387265 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-aaae4706-f75e-4f3a-a683-83d6780ec9d9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:07.394782 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-aaae4706-f75e-4f3a-a683-83d6780ec9d9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:07.394782 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-aaae4706-f75e-4f3a-a683-83d6780ec9d9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:07.394782 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-aaae4706-f75e-4f3a-a683-83d6780ec9d9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:07.562788 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-aaae4706-f75e-4f3a-a683-83d6780ec9d9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:07.572223 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-aaae4706-f75e-4f3a-a683-83d6780ec9d9 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1527 microversion: 2.1 time: 0.198183 Oct 28 09:53:07.572907 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 319/613] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:07 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1527 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:53:07.621707 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-b884563a-4679-4029-b8b8-416087a712bf tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:07.622263 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-b884563a-4679-4029-b8b8-416087a712bf tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:07.629125 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b884563a-4679-4029-b8b8-416087a712bf tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:07.629583 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b884563a-4679-4029-b8b8-416087a712bf tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:07.630785 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b884563a-4679-4029-b8b8-416087a712bf tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:07.631216 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b884563a-4679-4029-b8b8-416087a712bf tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:07.790647 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-b884563a-4679-4029-b8b8-416087a712bf tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:07.798961 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-b884563a-4679-4029-b8b8-416087a712bf tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1760 microversion: 2.1 time: 0.181094 Oct 28 09:53:07.799536 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 295/614] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:07 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1760 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:53:08.028088 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-67bb39d8-ffae-436a-a13c-dcf6b39bd457 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:08.028735 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-67bb39d8-ffae-436a-a13c-dcf6b39bd457 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:08.035334 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-67bb39d8-ffae-436a-a13c-dcf6b39bd457 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:08.035782 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-67bb39d8-ffae-436a-a13c-dcf6b39bd457 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:08.036570 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-67bb39d8-ffae-436a-a13c-dcf6b39bd457 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:08.037046 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-67bb39d8-ffae-436a-a13c-dcf6b39bd457 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:08.168982 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-67bb39d8-ffae-436a-a13c-dcf6b39bd457 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:08.176972 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-67bb39d8-ffae-436a-a13c-dcf6b39bd457 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1677 microversion: 2.1 time: 0.153136 Oct 28 09:53:08.187535 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 320/615] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:08 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:08.209317 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-50bf9c98-5bbc-4e56-a1e6-db9b3c8a643f tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:08.209931 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-50bf9c98-5bbc-4e56-a1e6-db9b3c8a643f tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] [instance: f5c176dc-eadc-474f-9c63-b2d9326b5452] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:08.216303 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-50bf9c98-5bbc-4e56-a1e6-db9b3c8a643f tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:08.216682 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-50bf9c98-5bbc-4e56-a1e6-db9b3c8a643f tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:08.222212 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-50bf9c98-5bbc-4e56-a1e6-db9b3c8a643f tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:08.222212 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-50bf9c98-5bbc-4e56-a1e6-db9b3c8a643f tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:08.396139 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-50bf9c98-5bbc-4e56-a1e6-db9b3c8a643f tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c20508e9de040b7a529cebb1c00947b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536d216676aa407f947e6a96788d6ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:08.404089 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-50bf9c98-5bbc-4e56-a1e6-db9b3c8a643f tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] 10.222.0.104 "GET /compute/v2.1/servers/f5c176dc-eadc-474f-9c63-b2d9326b5452" status: 200 len: 1318 microversion: 2.1 time: 0.198571 Oct 28 09:53:08.404688 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 296/616] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:08 2021] GET /compute/v2.1/servers/f5c176dc-eadc-474f-9c63-b2d9326b5452 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:08.576708 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [req-f91b4307-d196-4494-8f21-90e7464bbbb7 req-f2403252-84fa-4d1e-b947-43d0be69cd84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a9b7bca-6189-4a5d-a9cb-ea0af980d95f", "name": "network-vif-deleted", "tag": "2727ba0b-5ab2-4e16-98f8-42105ba1b2ba"}]} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:08.578219 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:53:08.578219 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 09:53:08.589223 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-f91b4307-d196-4494-8f21-90e7464bbbb7 req-f2403252-84fa-4d1e-b947-43d0be69cd84 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:08.589742 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-f91b4307-d196-4494-8f21-90e7464bbbb7 req-f2403252-84fa-4d1e-b947-43d0be69cd84 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:08.594250 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-d656a834-106a-4562-bf0e-c7d29ceb2d15 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:08.594589 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-d656a834-106a-4562-bf0e-c7d29ceb2d15 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:08.601955 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d656a834-106a-4562-bf0e-c7d29ceb2d15 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:08.603378 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d656a834-106a-4562-bf0e-c7d29ceb2d15 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:08.603519 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.compute.server_external_events [req-f91b4307-d196-4494-8f21-90e7464bbbb7 req-f2403252-84fa-4d1e-b947-43d0be69cd84 service nova] Creating event network-vif-deleted:2727ba0b-5ab2-4e16-98f8-42105ba1b2ba for instance 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f on hv-cinder-81571 Oct 28 09:53:08.604034 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d656a834-106a-4562-bf0e-c7d29ceb2d15 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:08.604466 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d656a834-106a-4562-bf0e-c7d29ceb2d15 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:08.608910 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [req-f91b4307-d196-4494-8f21-90e7464bbbb7 req-f2403252-84fa-4d1e-b947-43d0be69cd84 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035747 Oct 28 09:53:08.610103 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 321/617] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:53:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:53:08.688940 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-d656a834-106a-4562-bf0e-c7d29ceb2d15 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:08.696332 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-d656a834-106a-4562-bf0e-c7d29ceb2d15 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1485 microversion: 2.1 time: 0.106000 Oct 28 09:53:08.696952 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 297/618] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:08 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1485 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:53:08.816886 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-417b7fb9-f76a-427f-b58f-86915394ecdf tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:08.817579 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-417b7fb9-f76a-427f-b58f-86915394ecdf tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:08.823847 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-417b7fb9-f76a-427f-b58f-86915394ecdf tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:08.824331 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-417b7fb9-f76a-427f-b58f-86915394ecdf tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:08.825133 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-417b7fb9-f76a-427f-b58f-86915394ecdf tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:08.825552 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-417b7fb9-f76a-427f-b58f-86915394ecdf tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:09.052789 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-417b7fb9-f76a-427f-b58f-86915394ecdf tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:09.063350 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-417b7fb9-f76a-427f-b58f-86915394ecdf tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1760 microversion: 2.1 time: 0.250358 Oct 28 09:53:09.064358 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 322/619] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:08 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1760 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:09.195190 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-1fc1c220-b85c-4301-9a32-001fc89131c4 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:09.196071 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-1fc1c220-b85c-4301-9a32-001fc89131c4 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:09.202623 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1fc1c220-b85c-4301-9a32-001fc89131c4 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:09.203209 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1fc1c220-b85c-4301-9a32-001fc89131c4 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:09.204120 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1fc1c220-b85c-4301-9a32-001fc89131c4 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:09.204644 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1fc1c220-b85c-4301-9a32-001fc89131c4 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:09.338120 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-1fc1c220-b85c-4301-9a32-001fc89131c4 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:09.347557 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-1fc1c220-b85c-4301-9a32-001fc89131c4 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1677 microversion: 2.1 time: 0.156088 Oct 28 09:53:09.348141 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 298/620] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:09 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:09.421330 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-f3844e0e-be68-45fe-b5cc-417b7412766a tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:09.422022 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-f3844e0e-be68-45fe-b5cc-417b7412766a tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] [instance: f5c176dc-eadc-474f-9c63-b2d9326b5452] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:09.428719 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f3844e0e-be68-45fe-b5cc-417b7412766a tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:09.429253 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f3844e0e-be68-45fe-b5cc-417b7412766a tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:09.430322 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f3844e0e-be68-45fe-b5cc-417b7412766a tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:09.431110 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f3844e0e-be68-45fe-b5cc-417b7412766a tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:09.563462 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-f3844e0e-be68-45fe-b5cc-417b7412766a tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c20508e9de040b7a529cebb1c00947b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536d216676aa407f947e6a96788d6ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:09.571735 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-f3844e0e-be68-45fe-b5cc-417b7412766a tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] 10.222.0.104 "GET /compute/v2.1/servers/f5c176dc-eadc-474f-9c63-b2d9326b5452" status: 200 len: 1468 microversion: 2.1 time: 0.154335 Oct 28 09:53:09.572327 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 323/621] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:09 2021] GET /compute/v2.1/servers/f5c176dc-eadc-474f-9c63-b2d9326b5452 => generated 1468 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:09.611507 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-7858f383-62de-4819-95f3-70498b307ffd tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:09.611943 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-7858f383-62de-4819-95f3-70498b307ffd tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] [instance: f5c176dc-eadc-474f-9c63-b2d9326b5452] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:09.618612 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7858f383-62de-4819-95f3-70498b307ffd tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:09.619079 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7858f383-62de-4819-95f3-70498b307ffd tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:09.619855 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7858f383-62de-4819-95f3-70498b307ffd tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:09.620341 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7858f383-62de-4819-95f3-70498b307ffd tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:09.654873 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-7858f383-62de-4819-95f3-70498b307ffd tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] [instance: f5c176dc-eadc-474f-9c63-b2d9326b5452] Going to try to terminate instance {{(pid=123068) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 09:53:09.716986 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-728d5480-966e-4941-ab41-2125beb90dd0 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:09.716986 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-728d5480-966e-4941-ab41-2125beb90dd0 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:09.722729 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-728d5480-966e-4941-ab41-2125beb90dd0 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:09.723205 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-728d5480-966e-4941-ab41-2125beb90dd0 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:09.723993 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-728d5480-966e-4941-ab41-2125beb90dd0 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:09.724451 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-728d5480-966e-4941-ab41-2125beb90dd0 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:09.783907 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-728d5480-966e-4941-ab41-2125beb90dd0 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:09.784588 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-728d5480-966e-4941-ab41-2125beb90dd0 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:09.785244 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.objects.instance [None req-728d5480-966e-4941-ab41-2125beb90dd0 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lazy-loading 'fault' on Instance uuid 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f {{(pid=123069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 09:53:09.841418 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-728d5480-966e-4941-ab41-2125beb90dd0 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1d061616e34ae18c84197e88a79108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8b63299da71443297d36c7caabb111a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:09.849062 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-728d5480-966e-4941-ab41-2125beb90dd0 tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 200 len: 1316 microversion: 2.1 time: 0.139146 Oct 28 09:53:09.854913 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 324/622] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:09 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 1316 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:09.973831 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-7858f383-62de-4819-95f3-70498b307ffd tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] 10.222.0.104 "DELETE /compute/v2.1/servers/f5c176dc-eadc-474f-9c63-b2d9326b5452" status: 204 len: 0 microversion: 2.1 time: 0.364332 Oct 28 09:53:09.973831 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 299/623] 10.222.0.104 () {58 vars in 1243 bytes} [Thu Oct 28 09:53:09 2021] DELETE /compute/v2.1/servers/f5c176dc-eadc-474f-9c63-b2d9326b5452 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:53:09.981282 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-c0c41307-e81e-41e0-a4ea-c1e8f734b1c0 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:09.981889 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-c0c41307-e81e-41e0-a4ea-c1e8f734b1c0 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] [instance: f5c176dc-eadc-474f-9c63-b2d9326b5452] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:09.989354 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c0c41307-e81e-41e0-a4ea-c1e8f734b1c0 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:09.989807 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c0c41307-e81e-41e0-a4ea-c1e8f734b1c0 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:09.990649 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c0c41307-e81e-41e0-a4ea-c1e8f734b1c0 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:09.991085 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c0c41307-e81e-41e0-a4ea-c1e8f734b1c0 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:10.092252 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-5a26e8d6-42e8-462e-9901-c4e9afb9ca2d tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:10.093158 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-5a26e8d6-42e8-462e-9901-c4e9afb9ca2d tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:10.099928 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5a26e8d6-42e8-462e-9901-c4e9afb9ca2d tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:10.100377 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5a26e8d6-42e8-462e-9901-c4e9afb9ca2d tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:10.102415 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5a26e8d6-42e8-462e-9901-c4e9afb9ca2d tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:10.103087 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5a26e8d6-42e8-462e-9901-c4e9afb9ca2d tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:10.143179 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-c0c41307-e81e-41e0-a4ea-c1e8f734b1c0 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c20508e9de040b7a529cebb1c00947b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536d216676aa407f947e6a96788d6ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:10.152288 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-c0c41307-e81e-41e0-a4ea-c1e8f734b1c0 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] 10.222.0.104 "GET /compute/v2.1/servers/f5c176dc-eadc-474f-9c63-b2d9326b5452" status: 200 len: 1474 microversion: 2.1 time: 0.174720 Oct 28 09:53:10.164988 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 325/624] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:09 2021] GET /compute/v2.1/servers/f5c176dc-eadc-474f-9c63-b2d9326b5452 => generated 1474 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:10.276171 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-5a26e8d6-42e8-462e-9901-c4e9afb9ca2d tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:10.292408 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-5a26e8d6-42e8-462e-9901-c4e9afb9ca2d tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1760 microversion: 2.1 time: 0.203389 Oct 28 09:53:10.292408 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 300/625] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:10 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1760 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:53:10.369991 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-be7be1c3-0ee2-4445-b6ae-0adf8e020b97 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:10.371069 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-be7be1c3-0ee2-4445-b6ae-0adf8e020b97 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:10.378069 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-be7be1c3-0ee2-4445-b6ae-0adf8e020b97 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:10.378510 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-be7be1c3-0ee2-4445-b6ae-0adf8e020b97 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:10.380847 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-be7be1c3-0ee2-4445-b6ae-0adf8e020b97 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:10.380847 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-be7be1c3-0ee2-4445-b6ae-0adf8e020b97 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:10.780965 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-be7be1c3-0ee2-4445-b6ae-0adf8e020b97 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:10.789531 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-be7be1c3-0ee2-4445-b6ae-0adf8e020b97 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1677 microversion: 2.1 time: 0.424991 Oct 28 09:53:10.793474 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 326/626] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:10 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1677 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:10.869510 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-0b156541-bdb8-421f-8566-941466228e7f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:10.870278 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-0b156541-bdb8-421f-8566-941466228e7f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] [instance: 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:10.880725 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0b156541-bdb8-421f-8566-941466228e7f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:10.881267 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0b156541-bdb8-421f-8566-941466228e7f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:10.883876 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0b156541-bdb8-421f-8566-941466228e7f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:10.884788 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0b156541-bdb8-421f-8566-941466228e7f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:10.901151 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.wsgi [None req-0b156541-bdb8-421f-8566-941466228e7f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] HTTP exception thrown: Instance 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f could not be found. Oct 28 09:53:10.901891 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-0b156541-bdb8-421f-8566-941466228e7f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] Returning 404 to user: Instance 1a9b7bca-6189-4a5d-a9cb-ea0af980d95f could not be found. {{(pid=123068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:53:10.902860 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-0b156541-bdb8-421f-8566-941466228e7f tempest-ServerRescueNegativeTestJSON-1778616609 tempest-ServerRescueNegativeTestJSON-1778616609-project] 10.222.0.104 "GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f" status: 404 len: 111 microversion: 2.1 time: 0.039477 Oct 28 09:53:10.907583 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 301/627] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:10 2021] GET /compute/v2.1/servers/1a9b7bca-6189-4a5d-a9cb-ea0af980d95f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:53:11.027429 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [req-0ff72f5e-c77a-4189-8692-a3696ed670d2 req-f0c2be2d-917d-4f85-a5c6-1e68e73cba51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a4e433d-b808-4128-9e1e-cd8f5f7e20f4", "name": "network-vif-deleted", "tag": "a76427d7-3f5c-4e87-ab53-ee0815c5d946"}]} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:11.029651 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:53:11.029651 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 09:53:11.043578 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-0ff72f5e-c77a-4189-8692-a3696ed670d2 req-f0c2be2d-917d-4f85-a5c6-1e68e73cba51 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:11.044154 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-0ff72f5e-c77a-4189-8692-a3696ed670d2 req-f0c2be2d-917d-4f85-a5c6-1e68e73cba51 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:11.066363 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.compute.server_external_events [req-0ff72f5e-c77a-4189-8692-a3696ed670d2 req-f0c2be2d-917d-4f85-a5c6-1e68e73cba51 service nova] Creating event network-vif-deleted:a76427d7-3f5c-4e87-ab53-ee0815c5d946 for instance 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 on hv-cinder-81571 Oct 28 09:53:11.075584 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [req-0ff72f5e-c77a-4189-8692-a3696ed670d2 req-f0c2be2d-917d-4f85-a5c6-1e68e73cba51 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051464 Oct 28 09:53:11.076450 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 327/628] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:53:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:11.185337 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-e33b30f8-4974-4080-8157-1053ea5b8441 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:11.186893 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-e33b30f8-4974-4080-8157-1053ea5b8441 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] [instance: f5c176dc-eadc-474f-9c63-b2d9326b5452] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:11.193829 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e33b30f8-4974-4080-8157-1053ea5b8441 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:11.194612 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e33b30f8-4974-4080-8157-1053ea5b8441 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:11.197397 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e33b30f8-4974-4080-8157-1053ea5b8441 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:11.197397 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e33b30f8-4974-4080-8157-1053ea5b8441 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:11.318332 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-149bd447-29c4-45aa-b727-e54276042bdd tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:11.334399 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-149bd447-29c4-45aa-b727-e54276042bdd tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:11.344444 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-149bd447-29c4-45aa-b727-e54276042bdd tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:11.345259 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-149bd447-29c4-45aa-b727-e54276042bdd tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:11.346312 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-149bd447-29c4-45aa-b727-e54276042bdd tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:11.347031 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-149bd447-29c4-45aa-b727-e54276042bdd tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:11.605493 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-e33b30f8-4974-4080-8157-1053ea5b8441 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c20508e9de040b7a529cebb1c00947b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536d216676aa407f947e6a96788d6ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:11.634981 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-e33b30f8-4974-4080-8157-1053ea5b8441 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] 10.222.0.104 "GET /compute/v2.1/servers/f5c176dc-eadc-474f-9c63-b2d9326b5452" status: 200 len: 1474 microversion: 2.1 time: 0.457135 Oct 28 09:53:11.641456 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 302/629] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:11 2021] GET /compute/v2.1/servers/f5c176dc-eadc-474f-9c63-b2d9326b5452 => generated 1474 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:11.729158 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-149bd447-29c4-45aa-b727-e54276042bdd tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:11.739154 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-149bd447-29c4-45aa-b727-e54276042bdd tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1763 microversion: 2.1 time: 0.424798 Oct 28 09:53:11.769107 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 328/630] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:11 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1763 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:11.829609 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-f6619708-6736-44f7-a37c-16fcac22ae2e tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:11.830793 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-f6619708-6736-44f7-a37c-16fcac22ae2e tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:11.838637 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f6619708-6736-44f7-a37c-16fcac22ae2e tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:11.870847 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f6619708-6736-44f7-a37c-16fcac22ae2e tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:11.874168 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f6619708-6736-44f7-a37c-16fcac22ae2e tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:11.881941 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f6619708-6736-44f7-a37c-16fcac22ae2e tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:11.976812 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f6619708-6736-44f7-a37c-16fcac22ae2e tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:11.977476 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f6619708-6736-44f7-a37c-16fcac22ae2e tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:11.978051 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.objects.instance [None req-f6619708-6736-44f7-a37c-16fcac22ae2e tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lazy-loading 'fault' on Instance uuid 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 {{(pid=123068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 09:53:12.061570 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-f6619708-6736-44f7-a37c-16fcac22ae2e tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:12.074359 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-f6619708-6736-44f7-a37c-16fcac22ae2e tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 200 len: 1331 microversion: 2.1 time: 0.254621 Oct 28 09:53:12.075986 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 303/631] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:11 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 1331 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:12.655352 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-e05797d6-4f61-4666-9134-5da032f90bb6 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:12.656644 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-e05797d6-4f61-4666-9134-5da032f90bb6 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] [instance: f5c176dc-eadc-474f-9c63-b2d9326b5452] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:12.674497 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e05797d6-4f61-4666-9134-5da032f90bb6 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:12.679744 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e05797d6-4f61-4666-9134-5da032f90bb6 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:12.679744 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e05797d6-4f61-4666-9134-5da032f90bb6 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:12.679744 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e05797d6-4f61-4666-9134-5da032f90bb6 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:12.808271 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-e05797d6-4f61-4666-9134-5da032f90bb6 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c20508e9de040b7a529cebb1c00947b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536d216676aa407f947e6a96788d6ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:12.832118 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-e05797d6-4f61-4666-9134-5da032f90bb6 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] 10.222.0.104 "GET /compute/v2.1/servers/f5c176dc-eadc-474f-9c63-b2d9326b5452" status: 200 len: 1432 microversion: 2.1 time: 0.180551 Oct 28 09:53:12.833230 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 329/632] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:12 2021] GET /compute/v2.1/servers/f5c176dc-eadc-474f-9c63-b2d9326b5452 => generated 1432 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:13.093685 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-8c260f1d-5690-454a-911d-b509c2642082 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:13.094405 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-8c260f1d-5690-454a-911d-b509c2642082 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:13.103958 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [req-50ffc338-4ed1-48bc-b14a-b29ada26c74e req-c5999468-ce7a-4940-b821-5b7a30a098d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5c176dc-eadc-474f-9c63-b2d9326b5452", "name": "network-vif-deleted", "tag": "6d789963-66cb-4e9a-97f8-5e3ca3ee7e4d"}]} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:13.105965 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:53:13.105965 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 09:53:13.118082 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-50ffc338-4ed1-48bc-b14a-b29ada26c74e req-c5999468-ce7a-4940-b821-5b7a30a098d8 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:13.118247 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8c260f1d-5690-454a-911d-b509c2642082 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:13.118247 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8c260f1d-5690-454a-911d-b509c2642082 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:13.119027 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8c260f1d-5690-454a-911d-b509c2642082 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:13.119445 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8c260f1d-5690-454a-911d-b509c2642082 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:13.121550 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-50ffc338-4ed1-48bc-b14a-b29ada26c74e req-c5999468-ce7a-4940-b821-5b7a30a098d8 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:13.141978 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.wsgi [None req-8c260f1d-5690-454a-911d-b509c2642082 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] HTTP exception thrown: Instance 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 could not be found. Oct 28 09:53:13.142676 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-8c260f1d-5690-454a-911d-b509c2642082 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Returning 404 to user: Instance 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 could not be found. {{(pid=123068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:53:13.143696 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-8c260f1d-5690-454a-911d-b509c2642082 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 404 len: 111 microversion: 2.1 time: 0.054121 Oct 28 09:53:13.144770 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 304/633] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:13 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:53:13.146676 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.compute.server_external_events [req-50ffc338-4ed1-48bc-b14a-b29ada26c74e req-c5999468-ce7a-4940-b821-5b7a30a098d8 service nova] Creating event network-vif-deleted:6d789963-66cb-4e9a-97f8-5e3ca3ee7e4d for instance f5c176dc-eadc-474f-9c63-b2d9326b5452 on hv-cinder-81571 Oct 28 09:53:13.158592 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [req-50ffc338-4ed1-48bc-b14a-b29ada26c74e req-c5999468-ce7a-4940-b821-5b7a30a098d8 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053107 Oct 28 09:53:13.158592 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 330/634] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:53:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:53:13.172354 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-c21d847c-c8a0-4bed-b353-27533f1c24d0 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '.version_select at 0x7fe121ecef70>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:13.334985 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-c21d847c-c8a0-4bed-b353-27533f1c24d0 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1508598530" status: 202 len: 0 microversion: 2.1 time: 0.177774 Oct 28 09:53:13.340634 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 305/635] 10.222.0.104 () {58 vars in 1225 bytes} [Thu Oct 28 09:53:13 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1508598530 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:53:13.852166 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-7b9d12fe-5a4a-46c4-b2d1-7623855f3593 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:13.852948 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-7b9d12fe-5a4a-46c4-b2d1-7623855f3593 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] [instance: f5c176dc-eadc-474f-9c63-b2d9326b5452] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:13.870822 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7b9d12fe-5a4a-46c4-b2d1-7623855f3593 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:13.871259 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7b9d12fe-5a4a-46c4-b2d1-7623855f3593 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:13.872041 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7b9d12fe-5a4a-46c4-b2d1-7623855f3593 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:13.872465 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7b9d12fe-5a4a-46c4-b2d1-7623855f3593 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:13.915876 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7b9d12fe-5a4a-46c4-b2d1-7623855f3593 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:13.916868 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7b9d12fe-5a4a-46c4-b2d1-7623855f3593 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:13.917533 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.objects.instance [None req-7b9d12fe-5a4a-46c4-b2d1-7623855f3593 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lazy-loading 'fault' on Instance uuid f5c176dc-eadc-474f-9c63-b2d9326b5452 {{(pid=123069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 09:53:14.047053 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-7b9d12fe-5a4a-46c4-b2d1-7623855f3593 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c20508e9de040b7a529cebb1c00947b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '536d216676aa407f947e6a96788d6ae1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:14.061519 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-7b9d12fe-5a4a-46c4-b2d1-7623855f3593 tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] 10.222.0.104 "GET /compute/v2.1/servers/f5c176dc-eadc-474f-9c63-b2d9326b5452" status: 200 len: 1308 microversion: 2.1 time: 0.213671 Oct 28 09:53:14.063349 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 331/636] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:13 2021] GET /compute/v2.1/servers/f5c176dc-eadc-474f-9c63-b2d9326b5452 => generated 1308 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:14.916300 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-df020509-12c4-42d5-9946-66979256999d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'create', calling method: .version_select at 0x7fe122042700>, body: {"keypair": {"name": "tempest-keypair-672342344"}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:14.936138 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.quota [None req-df020509-12c4-42d5-9946-66979256999d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Getting quotas for project 8d7839b812b745549a72a1e089b6f4e9. Resources: {'key_pairs'} {{(pid=123068) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 09:53:14.943606 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.quota [None req-df020509-12c4-42d5-9946-66979256999d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Getting quotas for user 62731dd3e3c54a73b941292530dfa850 and project 8d7839b812b745549a72a1e089b6f4e9. Resources: {'key_pairs'} {{(pid=123068) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 09:53:15.079872 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-54049453-f007-4159-ad2d-124142da1f2b tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:15.081456 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-54049453-f007-4159-ad2d-124142da1f2b tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] [instance: f5c176dc-eadc-474f-9c63-b2d9326b5452] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:15.091876 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-54049453-f007-4159-ad2d-124142da1f2b tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:15.093055 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-54049453-f007-4159-ad2d-124142da1f2b tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:15.094304 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-54049453-f007-4159-ad2d-124142da1f2b tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:15.094945 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-54049453-f007-4159-ad2d-124142da1f2b tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:15.113022 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.wsgi [None req-54049453-f007-4159-ad2d-124142da1f2b tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] HTTP exception thrown: Instance f5c176dc-eadc-474f-9c63-b2d9326b5452 could not be found. Oct 28 09:53:15.113969 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-54049453-f007-4159-ad2d-124142da1f2b tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] Returning 404 to user: Instance f5c176dc-eadc-474f-9c63-b2d9326b5452 could not be found. {{(pid=123069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:53:15.115054 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-54049453-f007-4159-ad2d-124142da1f2b tempest-VolumesNegativeTest-1769838745 tempest-VolumesNegativeTest-1769838745-project] 10.222.0.104 "GET /compute/v2.1/servers/f5c176dc-eadc-474f-9c63-b2d9326b5452" status: 404 len: 111 microversion: 2.1 time: 0.039485 Oct 28 09:53:15.123194 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 332/637] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:15 2021] GET /compute/v2.1/servers/f5c176dc-eadc-474f-9c63-b2d9326b5452 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:53:15.304055 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.quota [None req-df020509-12c4-42d5-9946-66979256999d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Getting quotas for project 8d7839b812b745549a72a1e089b6f4e9. Resources: {'key_pairs'} {{(pid=123068) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 09:53:15.311548 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.quota [None req-df020509-12c4-42d5-9946-66979256999d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Getting quotas for user 62731dd3e3c54a73b941292530dfa850 and project 8d7839b812b745549a72a1e089b6f4e9. Resources: {'key_pairs'} {{(pid=123068) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 09:53:15.332031 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-df020509-12c4-42d5-9946-66979256999d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.420559 Oct 28 09:53:15.332865 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 306/638] 10.222.0.104 () {60 vars in 1162 bytes} [Thu Oct 28 09:53:14 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:18.410017 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-bcce8f2b-ed83-4950-a1c3-ae692be4bdf7 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-562584172", "imageRef": "623b30fc-1d92-46d9-b556-b9b963f3d76c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c35fd8ce-1440-413c-a793-3622068b4395"}], "security_groups": [{"name": "tempest-securitygroup--163224967"}], "key_name": "tempest-keypair-672342344", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:18.528130 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.network.neutron [None req-bcce8f2b-ed83-4950-a1c3-ae692be4bdf7 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] validate_networks() for [('c35fd8ce-1440-413c-a793-3622068b4395', None, None, None, None, None)] {{(pid=123069) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 09:53:18.966277 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-bcce8f2b-ed83-4950-a1c3-ae692be4bdf7 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Flavor limits 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:53:18.966786 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-bcce8f2b-ed83-4950-a1c3-ae692be4bdf7 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Image limits 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:53:18.967413 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-bcce8f2b-ed83-4950-a1c3-ae692be4bdf7 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Flavor pref 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:53:18.968138 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-bcce8f2b-ed83-4950-a1c3-ae692be4bdf7 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Image pref 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:53:18.968734 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-bcce8f2b-ed83-4950-a1c3-ae692be4bdf7 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:53:18.981827 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bcce8f2b-ed83-4950-a1c3-ae692be4bdf7 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:18.982175 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bcce8f2b-ed83-4950-a1c3-ae692be4bdf7 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:18.983300 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bcce8f2b-ed83-4950-a1c3-ae692be4bdf7 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:18.983829 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bcce8f2b-ed83-4950-a1c3-ae692be4bdf7 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:19.005909 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.quota [None req-bcce8f2b-ed83-4950-a1c3-ae692be4bdf7 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Getting quotas for project 8d7839b812b745549a72a1e089b6f4e9. Resources: {'ram', 'cores', 'instances'} {{(pid=123069) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 09:53:19.012200 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.quota [None req-bcce8f2b-ed83-4950-a1c3-ae692be4bdf7 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Getting quotas for user 62731dd3e3c54a73b941292530dfa850 and project 8d7839b812b745549a72a1e089b6f4e9. Resources: {'ram', 'cores', 'instances'} {{(pid=123069) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 09:53:19.024893 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-bcce8f2b-ed83-4950-a1c3-ae692be4bdf7 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Going to run 1 instances... {{(pid=123069) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 09:53:19.027368 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-bcce8f2b-ed83-4950-a1c3-ae692be4bdf7 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='623b30fc-1d92-46d9-b556-b9b963f3d76c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 09:53:19.199742 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-72fd9abe-7569-4bbf-9b55-9fdec302596f tempest-VolumesNegativeTest-1372246196 tempest-VolumesNegativeTest-1372246196-project] Action: 'create', calling method: .version_select at 0x7fe121d3b670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1758730179", "metadata": {"Type": "work"}}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:19.201143 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-72fd9abe-7569-4bbf-9b55-9fdec302596f tempest-VolumesNegativeTest-1372246196 tempest-VolumesNegativeTest-1372246196-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:53:19.202045 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-72fd9abe-7569-4bbf-9b55-9fdec302596f tempest-VolumesNegativeTest-1372246196 tempest-VolumesNegativeTest-1372246196-project] 10.222.0.104 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.144311 Oct 28 09:53:19.202642 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 307/639] 10.222.0.104 () {60 vars in 1160 bytes} [Thu Oct 28 09:53:19 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 145 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 09:53:19.212297 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-b0f414e3-2f3e-4516-baf0-8f918e7e8da3 tempest-VolumesNegativeTest-1372246196 tempest-VolumesNegativeTest-1372246196-project] Action: 'create', calling method: .version_select at 0x7fe1220dd0d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1639129044", "metadata": {"Type": "work"}}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:19.213531 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-b0f414e3-2f3e-4516-baf0-8f918e7e8da3 tempest-VolumesNegativeTest-1372246196 tempest-VolumesNegativeTest-1372246196-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:53:19.214312 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-b0f414e3-2f3e-4516-baf0-8f918e7e8da3 tempest-VolumesNegativeTest-1372246196 tempest-VolumesNegativeTest-1372246196-project] 10.222.0.104 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006235 Oct 28 09:53:19.214825 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 308/640] 10.222.0.104 () {60 vars in 1160 bytes} [Thu Oct 28 09:53:19 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 09:53:19.223850 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-0a85d319-707f-47d1-aa77-ecaa78f61fc7 tempest-VolumesNegativeTest-1372246196 tempest-VolumesNegativeTest-1372246196-project] Action: 'create', calling method: .version_select at 0x7fe121ece5e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-183465927", "metadata": {"Type": "work"}}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:19.224972 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-0a85d319-707f-47d1-aa77-ecaa78f61fc7 tempest-VolumesNegativeTest-1372246196 tempest-VolumesNegativeTest-1372246196-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:53:19.225754 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-0a85d319-707f-47d1-aa77-ecaa78f61fc7 tempest-VolumesNegativeTest-1372246196 tempest-VolumesNegativeTest-1372246196-project] 10.222.0.104 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005940 Oct 28 09:53:19.226759 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 309/641] 10.222.0.104 () {60 vars in 1160 bytes} [Thu Oct 28 09:53:19 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 09:53:19.235979 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-506a98d7-beaf-47dc-8ad7-bbd65815d6f9 tempest-VolumesNegativeTest-1372246196 tempest-VolumesNegativeTest-1372246196-project] Calling method '.version_select at 0x7fe121cebf70>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:19.265920 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.wsgi [None req-506a98d7-beaf-47dc-8ad7-bbd65815d6f9 tempest-VolumesNegativeTest-1372246196 tempest-VolumesNegativeTest-1372246196-project] HTTP exception thrown: Volume tempest-invalid-34701931 could not be found. Oct 28 09:53:19.266768 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-506a98d7-beaf-47dc-8ad7-bbd65815d6f9 tempest-VolumesNegativeTest-1372246196 tempest-VolumesNegativeTest-1372246196-project] Returning 404 to user: Volume tempest-invalid-34701931 could not be found. {{(pid=123068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:53:19.267815 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-506a98d7-beaf-47dc-8ad7-bbd65815d6f9 tempest-VolumesNegativeTest-1372246196 tempest-VolumesNegativeTest-1372246196-project] 10.222.0.104 "DELETE /compute/v2.1/os-volumes/tempest-invalid-34701931" status: 404 len: 97 microversion: 2.1 time: 0.035867 Oct 28 09:53:19.268541 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 310/642] 10.222.0.104 () {58 vars in 1216 bytes} [Thu Oct 28 09:53:19 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-34701931 => generated 97 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 28 09:53:19.279369 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-221b9ad7-18b3-4e87-aa42-e2da6c948c0d tempest-VolumesNegativeTest-1372246196 tempest-VolumesNegativeTest-1372246196-project] 10.222.0.104 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005224 Oct 28 09:53:19.279916 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 311/643] 10.222.0.104 () {58 vars in 1144 bytes} [Thu Oct 28 09:53:19 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 28 09:53:19.290064 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-903dfe74-d0db-407f-b601-f7733ff241bc tempest-VolumesNegativeTest-1372246196 tempest-VolumesNegativeTest-1372246196-project] 10.222.0.104 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004373 Oct 28 09:53:19.290594 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 312/644] 10.222.0.104 () {58 vars in 1141 bytes} [Thu Oct 28 09:53:19 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 28 09:53:19.299655 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-dac68ed1-942a-4379-b4ae-ca640e8e9364 tempest-VolumesNegativeTest-1372246196 tempest-VolumesNegativeTest-1372246196-project] Calling method '.version_select at 0x7fe121cebc10>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:19.333746 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.wsgi [None req-dac68ed1-942a-4379-b4ae-ca640e8e9364 tempest-VolumesNegativeTest-1372246196 tempest-VolumesNegativeTest-1372246196-project] HTTP exception thrown: Volume 7fd20469-fdfe-46a6-9273-836b0951d0b5 could not be found. Oct 28 09:53:19.334716 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-dac68ed1-942a-4379-b4ae-ca640e8e9364 tempest-VolumesNegativeTest-1372246196 tempest-VolumesNegativeTest-1372246196-project] Returning 404 to user: Volume 7fd20469-fdfe-46a6-9273-836b0951d0b5 could not be found. {{(pid=123068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:53:19.335609 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-dac68ed1-942a-4379-b4ae-ca640e8e9364 tempest-VolumesNegativeTest-1372246196 tempest-VolumesNegativeTest-1372246196-project] 10.222.0.104 "DELETE /compute/v2.1/os-volumes/7fd20469-fdfe-46a6-9273-836b0951d0b5" status: 404 len: 109 microversion: 2.1 time: 0.039577 Oct 28 09:53:19.338517 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 313/645] 10.222.0.104 () {58 vars in 1252 bytes} [Thu Oct 28 09:53:19 2021] DELETE /compute/v2.1/os-volumes/7fd20469-fdfe-46a6-9273-836b0951d0b5 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:53:19.341699 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-bcce8f2b-ed83-4950-a1c3-ae692be4bdf7 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.935689 Oct 28 09:53:19.342648 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 333/646] 10.222.0.104 () {60 vars in 1151 bytes} [Thu Oct 28 09:53:18 2021] POST /compute/v2.1/servers => generated 403 bytes in 938 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 28 09:53:19.348634 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-b2b6135b-9c36-4dd9-bb1e-24e393acecbb tempest-VolumesNegativeTest-1372246196 tempest-VolumesNegativeTest-1372246196-project] Calling method '.version_select at 0x7fe121ece5e0>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:19.354475 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-68e9365a-ecaf-4a3e-9a1c-967dae0d446b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:19.355300 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-68e9365a-ecaf-4a3e-9a1c-967dae0d446b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:19.394319 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.wsgi [None req-b2b6135b-9c36-4dd9-bb1e-24e393acecbb tempest-VolumesNegativeTest-1372246196 tempest-VolumesNegativeTest-1372246196-project] HTTP exception thrown: Volume 1342310f-4a7d-47f8-927d-1a7627dbb35a could not be found. Oct 28 09:53:19.394913 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-b2b6135b-9c36-4dd9-bb1e-24e393acecbb tempest-VolumesNegativeTest-1372246196 tempest-VolumesNegativeTest-1372246196-project] Returning 404 to user: Volume 1342310f-4a7d-47f8-927d-1a7627dbb35a could not be found. {{(pid=123068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:53:19.395730 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-b2b6135b-9c36-4dd9-bb1e-24e393acecbb tempest-VolumesNegativeTest-1372246196 tempest-VolumesNegativeTest-1372246196-project] 10.222.0.104 "GET /compute/v2.1/os-volumes/1342310f-4a7d-47f8-927d-1a7627dbb35a" status: 404 len: 109 microversion: 2.1 time: 0.051235 Oct 28 09:53:19.396276 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 314/647] 10.222.0.104 () {58 vars in 1249 bytes} [Thu Oct 28 09:53:19 2021] GET /compute/v2.1/os-volumes/1342310f-4a7d-47f8-927d-1a7627dbb35a => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 09:53:19.428565 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-68e9365a-ecaf-4a3e-9a1c-967dae0d446b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:19.442141 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-68e9365a-ecaf-4a3e-9a1c-967dae0d446b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f" status: 200 len: 1240 microversion: 2.1 time: 0.092896 Oct 28 09:53:19.444125 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 334/648] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:19 2021] GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f => generated 1240 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:53:19.823364 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-52cb60df-8c11-46cc-909b-439f5aa80260 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:19.823850 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-52cb60df-8c11-46cc-909b-439f5aa80260 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:19.830089 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-52cb60df-8c11-46cc-909b-439f5aa80260 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:19.830571 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-52cb60df-8c11-46cc-909b-439f5aa80260 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:19.831379 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-52cb60df-8c11-46cc-909b-439f5aa80260 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:19.831806 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-52cb60df-8c11-46cc-909b-439f5aa80260 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:19.867144 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-52cb60df-8c11-46cc-909b-439f5aa80260 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/os-volume_attachments/f5e03358-aef2-4e06-a636-f0967ef104da" status: 200 len: 194 microversion: 2.20 time: 0.048718 Oct 28 09:53:19.868026 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 315/649] 10.222.0.104 () {60 vars in 1458 bytes} [Thu Oct 28 09:53:19 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/os-volume_attachments/f5e03358-aef2-4e06-a636-f0967ef104da => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:53:19.988572 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-4ca81a60-900d-44b9-88cd-727816cbb9e8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:19.989402 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-4ca81a60-900d-44b9-88cd-727816cbb9e8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:19.997314 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4ca81a60-900d-44b9-88cd-727816cbb9e8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:19.997773 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4ca81a60-900d-44b9-88cd-727816cbb9e8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:19.999939 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4ca81a60-900d-44b9-88cd-727816cbb9e8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:19.999939 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4ca81a60-900d-44b9-88cd-727816cbb9e8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:20.167342 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.objects.instance [None req-4ca81a60-900d-44b9-88cd-727816cbb9e8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lazy-loading 'services' on Instance uuid b49b31e1-36d8-4096-a5fc-b2d46ef922eb {{(pid=123069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 09:53:20.466583 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-ce878a84-32e6-4134-838e-d1a36c3f09d8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:20.471364 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-ce878a84-32e6-4134-838e-d1a36c3f09d8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:20.471505 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-4ca81a60-900d-44b9-88cd-727816cbb9e8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "DELETE /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/os-volume_attachments/f5e03358-aef2-4e06-a636-f0967ef104da" status: 202 len: 0 microversion: 2.20 time: 0.484464 Oct 28 09:53:20.471505 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 335/650] 10.222.0.104 () {60 vars in 1461 bytes} [Thu Oct 28 09:53:19 2021] DELETE /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/os-volume_attachments/f5e03358-aef2-4e06-a636-f0967ef104da => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:53:20.478476 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ce878a84-32e6-4134-838e-d1a36c3f09d8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:20.478933 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ce878a84-32e6-4134-838e-d1a36c3f09d8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:20.479815 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ce878a84-32e6-4134-838e-d1a36c3f09d8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:20.480149 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ce878a84-32e6-4134-838e-d1a36c3f09d8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:20.481272 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-efa0b6d3-75bb-4cf2-a2c6-1daa7aafbedc tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:20.493090 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-efa0b6d3-75bb-4cf2-a2c6-1daa7aafbedc tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:20.500330 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-efa0b6d3-75bb-4cf2-a2c6-1daa7aafbedc tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:20.500330 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-efa0b6d3-75bb-4cf2-a2c6-1daa7aafbedc tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:20.501169 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-efa0b6d3-75bb-4cf2-a2c6-1daa7aafbedc tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:20.501574 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-efa0b6d3-75bb-4cf2-a2c6-1daa7aafbedc tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:20.556307 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-efa0b6d3-75bb-4cf2-a2c6-1daa7aafbedc tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078888 Oct 28 09:53:20.556931 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 336/651] 10.222.0.104 () {60 vars in 1347 bytes} [Thu Oct 28 09:53:20 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 09:53:20.597400 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-ce878a84-32e6-4134-838e-d1a36c3f09d8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:20.611664 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-ce878a84-32e6-4134-838e-d1a36c3f09d8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f" status: 200 len: 1244 microversion: 2.1 time: 0.153012 Oct 28 09:53:20.612495 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 316/652] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:20 2021] GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f => generated 1244 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:21.568130 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-35ce7b98-cf9d-425b-9743-17a8143e328d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:21.569105 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-35ce7b98-cf9d-425b-9743-17a8143e328d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:21.577054 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-35ce7b98-cf9d-425b-9743-17a8143e328d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:21.577503 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-35ce7b98-cf9d-425b-9743-17a8143e328d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:21.578282 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-35ce7b98-cf9d-425b-9743-17a8143e328d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:21.578707 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-35ce7b98-cf9d-425b-9743-17a8143e328d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:21.611074 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-35ce7b98-cf9d-425b-9743-17a8143e328d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046893 Oct 28 09:53:21.611644 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 337/653] 10.222.0.104 () {60 vars in 1347 bytes} [Thu Oct 28 09:53:21 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:53:21.628563 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-1f8479ce-e8da-4037-9ea1-d353c1c7990e tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:21.629225 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-1f8479ce-e8da-4037-9ea1-d353c1c7990e tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:21.637701 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1f8479ce-e8da-4037-9ea1-d353c1c7990e tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:21.645205 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1f8479ce-e8da-4037-9ea1-d353c1c7990e tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:21.645205 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1f8479ce-e8da-4037-9ea1-d353c1c7990e tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:21.645205 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1f8479ce-e8da-4037-9ea1-d353c1c7990e tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:21.708380 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-1f8479ce-e8da-4037-9ea1-d353c1c7990e tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:21.716819 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-1f8479ce-e8da-4037-9ea1-d353c1c7990e tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f" status: 200 len: 1236 microversion: 2.1 time: 0.091792 Oct 28 09:53:21.717420 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 317/654] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:21 2021] GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f => generated 1236 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:22.622961 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-325edd3f-6256-4727-b1dc-1a5229e80928 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:22.623876 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-325edd3f-6256-4727-b1dc-1a5229e80928 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:22.631260 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-325edd3f-6256-4727-b1dc-1a5229e80928 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:22.631693 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-325edd3f-6256-4727-b1dc-1a5229e80928 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:22.633224 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-325edd3f-6256-4727-b1dc-1a5229e80928 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:22.633658 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-325edd3f-6256-4727-b1dc-1a5229e80928 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:22.685701 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-325edd3f-6256-4727-b1dc-1a5229e80928 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065877 Oct 28 09:53:22.686515 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 338/655] 10.222.0.104 () {60 vars in 1347 bytes} [Thu Oct 28 09:53:22 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:53:22.735181 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-c7ce3237-e248-435e-8113-deed23f64e96 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:22.735864 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-c7ce3237-e248-435e-8113-deed23f64e96 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:22.745208 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c7ce3237-e248-435e-8113-deed23f64e96 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:22.745705 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c7ce3237-e248-435e-8113-deed23f64e96 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:22.746566 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c7ce3237-e248-435e-8113-deed23f64e96 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:22.747079 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c7ce3237-e248-435e-8113-deed23f64e96 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:22.822574 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-c7ce3237-e248-435e-8113-deed23f64e96 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:22.831086 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-c7ce3237-e248-435e-8113-deed23f64e96 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f" status: 200 len: 1236 microversion: 2.1 time: 0.099547 Oct 28 09:53:22.831547 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 318/656] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:22 2021] GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f => generated 1236 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:23.699461 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-053a8ca6-9b7d-4660-96ce-3987a3cc56a1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:23.700452 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-053a8ca6-9b7d-4660-96ce-3987a3cc56a1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:23.707119 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-053a8ca6-9b7d-4660-96ce-3987a3cc56a1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:23.707555 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-053a8ca6-9b7d-4660-96ce-3987a3cc56a1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:23.708323 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-053a8ca6-9b7d-4660-96ce-3987a3cc56a1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:23.708769 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-053a8ca6-9b7d-4660-96ce-3987a3cc56a1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:23.750505 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-053a8ca6-9b7d-4660-96ce-3987a3cc56a1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055517 Oct 28 09:53:23.751518 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 339/657] 10.222.0.104 () {60 vars in 1347 bytes} [Thu Oct 28 09:53:23 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 09:53:23.850298 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-f610a3af-2c80-42f4-813c-267c0b2085d4 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:23.851363 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-f610a3af-2c80-42f4-813c-267c0b2085d4 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:23.859066 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f610a3af-2c80-42f4-813c-267c0b2085d4 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:23.859556 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f610a3af-2c80-42f4-813c-267c0b2085d4 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:23.860458 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f610a3af-2c80-42f4-813c-267c0b2085d4 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:23.860922 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f610a3af-2c80-42f4-813c-267c0b2085d4 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:23.926317 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-f610a3af-2c80-42f4-813c-267c0b2085d4 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:23.934844 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-f610a3af-2c80-42f4-813c-267c0b2085d4 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f" status: 200 len: 1236 microversion: 2.1 time: 0.089308 Oct 28 09:53:23.935425 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 319/658] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:23 2021] GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f => generated 1236 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:53:24.764180 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-df74fa19-11c8-44fe-8c83-0538e760df46 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:24.765928 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-df74fa19-11c8-44fe-8c83-0538e760df46 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:24.777101 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-df74fa19-11c8-44fe-8c83-0538e760df46 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:24.777628 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-df74fa19-11c8-44fe-8c83-0538e760df46 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:24.778666 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-df74fa19-11c8-44fe-8c83-0538e760df46 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:24.784885 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-df74fa19-11c8-44fe-8c83-0538e760df46 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:24.838391 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-df74fa19-11c8-44fe-8c83-0538e760df46 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.077253 Oct 28 09:53:24.838391 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 340/659] 10.222.0.104 () {60 vars in 1347 bytes} [Thu Oct 28 09:53:24 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:53:24.959941 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-efc0f6da-495e-4c4c-b154-8a15c70c0a1f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:24.962202 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-efc0f6da-495e-4c4c-b154-8a15c70c0a1f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:24.972249 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-efc0f6da-495e-4c4c-b154-8a15c70c0a1f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:24.972783 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-efc0f6da-495e-4c4c-b154-8a15c70c0a1f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:24.973585 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-efc0f6da-495e-4c4c-b154-8a15c70c0a1f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:24.974021 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-efc0f6da-495e-4c4c-b154-8a15c70c0a1f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:25.062781 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-efc0f6da-495e-4c4c-b154-8a15c70c0a1f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:25.074018 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-efc0f6da-495e-4c4c-b154-8a15c70c0a1f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f" status: 200 len: 1300 microversion: 2.1 time: 0.119354 Oct 28 09:53:25.075748 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 320/660] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:24 2021] GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f => generated 1300 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:25.851460 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-70f8f68a-d57e-4afc-9f44-62be88fe7301 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:25.853189 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-70f8f68a-d57e-4afc-9f44-62be88fe7301 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:25.867481 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-70f8f68a-d57e-4afc-9f44-62be88fe7301 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:25.869914 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-70f8f68a-d57e-4afc-9f44-62be88fe7301 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:25.872156 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-70f8f68a-d57e-4afc-9f44-62be88fe7301 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:25.873640 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-70f8f68a-d57e-4afc-9f44-62be88fe7301 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:25.930222 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-70f8f68a-d57e-4afc-9f44-62be88fe7301 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.082486 Oct 28 09:53:25.934316 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 341/661] 10.222.0.104 () {60 vars in 1347 bytes} [Thu Oct 28 09:53:25 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:26.013785 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-0348dbe6-36e6-4f2c-a7d2-2271e8180ddf tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:26.014416 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-0348dbe6-36e6-4f2c-a7d2-2271e8180ddf tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:26.031256 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0348dbe6-36e6-4f2c-a7d2-2271e8180ddf tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:26.031726 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0348dbe6-36e6-4f2c-a7d2-2271e8180ddf tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:26.032944 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0348dbe6-36e6-4f2c-a7d2-2271e8180ddf tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:26.033404 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0348dbe6-36e6-4f2c-a7d2-2271e8180ddf tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:26.070145 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-0348dbe6-36e6-4f2c-a7d2-2271e8180ddf tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Going to try to terminate instance {{(pid=123068) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 09:53:26.097677 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-66531a0e-b2d2-47fb-879c-f87a126e78b3 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:26.104162 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-66531a0e-b2d2-47fb-879c-f87a126e78b3 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:26.117489 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-66531a0e-b2d2-47fb-879c-f87a126e78b3 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:26.118583 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-66531a0e-b2d2-47fb-879c-f87a126e78b3 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:26.120207 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-66531a0e-b2d2-47fb-879c-f87a126e78b3 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:26.121517 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-66531a0e-b2d2-47fb-879c-f87a126e78b3 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:26.345402 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-66531a0e-b2d2-47fb-879c-f87a126e78b3 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:26.353295 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-66531a0e-b2d2-47fb-879c-f87a126e78b3 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f" status: 200 len: 1365 microversion: 2.1 time: 0.262897 Oct 28 09:53:26.353959 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 342/662] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:26 2021] GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f => generated 1365 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:26.525141 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-0348dbe6-36e6-4f2c-a7d2-2271e8180ddf tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "DELETE /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 204 len: 0 microversion: 2.20 time: 0.524017 Oct 28 09:53:26.525663 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 321/663] 10.222.0.104 () {60 vars in 1284 bytes} [Thu Oct 28 09:53:25 2021] DELETE /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 28 09:53:26.542019 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-284e35f9-e815-41c3-8c41-c1b83e8be266 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:26.542019 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-284e35f9-e815-41c3-8c41-c1b83e8be266 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:26.542019 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-284e35f9-e815-41c3-8c41-c1b83e8be266 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:26.542810 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-284e35f9-e815-41c3-8c41-c1b83e8be266 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:26.543069 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-284e35f9-e815-41c3-8c41-c1b83e8be266 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:26.543433 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-284e35f9-e815-41c3-8c41-c1b83e8be266 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:26.700596 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-284e35f9-e815-41c3-8c41-c1b83e8be266 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:26.708845 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-284e35f9-e815-41c3-8c41-c1b83e8be266 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:26.710962 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-284e35f9-e815-41c3-8c41-c1b83e8be266 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:26.712346 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-284e35f9-e815-41c3-8c41-c1b83e8be266 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1727 microversion: 2.20 time: 0.182073 Oct 28 09:53:26.712957 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 343/664] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:53:26 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1727 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:53:27.371982 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-aaf8f9a8-54fe-4eb7-9958-8756208a93ee tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:27.372840 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-aaf8f9a8-54fe-4eb7-9958-8756208a93ee tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:27.379205 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-aaf8f9a8-54fe-4eb7-9958-8756208a93ee tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:27.379892 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-aaf8f9a8-54fe-4eb7-9958-8756208a93ee tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:27.380704 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-aaf8f9a8-54fe-4eb7-9958-8756208a93ee tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:27.381133 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-aaf8f9a8-54fe-4eb7-9958-8756208a93ee tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:27.522434 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-aaf8f9a8-54fe-4eb7-9958-8756208a93ee tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:27.530636 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-aaf8f9a8-54fe-4eb7-9958-8756208a93ee tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f" status: 200 len: 1365 microversion: 2.1 time: 0.162760 Oct 28 09:53:27.531318 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 322/665] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:27 2021] GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:27.730038 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-cb839b7c-629a-409c-ae80-f984e13f5c57 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:27.730733 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-cb839b7c-629a-409c-ae80-f984e13f5c57 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:27.737731 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-cb839b7c-629a-409c-ae80-f984e13f5c57 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:27.738169 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-cb839b7c-629a-409c-ae80-f984e13f5c57 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:27.738942 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-cb839b7c-629a-409c-ae80-f984e13f5c57 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:27.739373 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-cb839b7c-629a-409c-ae80-f984e13f5c57 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:28.031095 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-cb839b7c-629a-409c-ae80-f984e13f5c57 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:28.052414 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-cb839b7c-629a-409c-ae80-f984e13f5c57 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:28.054561 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-cb839b7c-629a-409c-ae80-f984e13f5c57 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:28.055760 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-cb839b7c-629a-409c-ae80-f984e13f5c57 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1727 microversion: 2.20 time: 0.329723 Oct 28 09:53:28.060511 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 344/666] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:53:27 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1727 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:28.547338 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-87aa94e7-07b1-4c0e-a7d1-9ca501fb1341 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:28.548596 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-87aa94e7-07b1-4c0e-a7d1-9ca501fb1341 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:28.557932 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-87aa94e7-07b1-4c0e-a7d1-9ca501fb1341 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:28.558409 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-87aa94e7-07b1-4c0e-a7d1-9ca501fb1341 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:28.559253 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-87aa94e7-07b1-4c0e-a7d1-9ca501fb1341 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:28.559985 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-87aa94e7-07b1-4c0e-a7d1-9ca501fb1341 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:28.888782 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [req-93d00df2-41dd-42ac-9e2f-a68adf695d49 req-3b991306-5dcf-45af-800e-bf12355d55eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "914bc218-ac76-4448-82e3-f4059c8f8a8f", "tag": "58893e81-1ce4-483e-b6b0-b386c74b972a"}]} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:28.890560 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:53:28.890560 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 09:53:28.904961 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-93d00df2-41dd-42ac-9e2f-a68adf695d49 req-3b991306-5dcf-45af-800e-bf12355d55eb service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:28.905701 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-93d00df2-41dd-42ac-9e2f-a68adf695d49 req-3b991306-5dcf-45af-800e-bf12355d55eb service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:28.918341 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.compute.server_external_events [req-93d00df2-41dd-42ac-9e2f-a68adf695d49 req-3b991306-5dcf-45af-800e-bf12355d55eb service nova] Creating event network-changed:58893e81-1ce4-483e-b6b0-b386c74b972a for instance 914bc218-ac76-4448-82e3-f4059c8f8a8f on hv-cinder-81571 Oct 28 09:53:28.924787 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [req-93d00df2-41dd-42ac-9e2f-a68adf695d49 req-3b991306-5dcf-45af-800e-bf12355d55eb service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038702 Oct 28 09:53:28.932726 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 345/667] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:53:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:53:28.983417 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-87aa94e7-07b1-4c0e-a7d1-9ca501fb1341 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:28.991067 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-87aa94e7-07b1-4c0e-a7d1-9ca501fb1341 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f" status: 200 len: 1365 microversion: 2.1 time: 0.447535 Oct 28 09:53:29.005242 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 323/668] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:28 2021] GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f => generated 1365 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:29.096499 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-c9e3ab87-673f-482c-9b1a-db5a8f7d1f60 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:29.099116 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-c9e3ab87-673f-482c-9b1a-db5a8f7d1f60 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:29.117134 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c9e3ab87-673f-482c-9b1a-db5a8f7d1f60 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:29.117755 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c9e3ab87-673f-482c-9b1a-db5a8f7d1f60 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:29.118605 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c9e3ab87-673f-482c-9b1a-db5a8f7d1f60 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:29.121015 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c9e3ab87-673f-482c-9b1a-db5a8f7d1f60 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:29.319169 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-c9e3ab87-673f-482c-9b1a-db5a8f7d1f60 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:29.344397 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-c9e3ab87-673f-482c-9b1a-db5a8f7d1f60 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:29.346692 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-c9e3ab87-673f-482c-9b1a-db5a8f7d1f60 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:29.347868 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-c9e3ab87-673f-482c-9b1a-db5a8f7d1f60 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1727 microversion: 2.20 time: 0.267010 Oct 28 09:53:29.349233 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 346/669] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:53:29 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1727 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:30.008502 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-5dbee7b5-1e89-4bbe-a7da-749d73ad906b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:30.009155 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-5dbee7b5-1e89-4bbe-a7da-749d73ad906b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:30.015613 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5dbee7b5-1e89-4bbe-a7da-749d73ad906b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:30.016066 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5dbee7b5-1e89-4bbe-a7da-749d73ad906b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:30.016897 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5dbee7b5-1e89-4bbe-a7da-749d73ad906b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:30.017343 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5dbee7b5-1e89-4bbe-a7da-749d73ad906b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:30.145563 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-5dbee7b5-1e89-4bbe-a7da-749d73ad906b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:30.153416 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-5dbee7b5-1e89-4bbe-a7da-749d73ad906b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f" status: 200 len: 1365 microversion: 2.1 time: 0.149045 Oct 28 09:53:30.157725 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 324/670] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:30 2021] GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:30.366896 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-6f52bc5f-8f4d-47cd-ac99-22f1723bd186 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:30.367558 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-6f52bc5f-8f4d-47cd-ac99-22f1723bd186 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:30.374763 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6f52bc5f-8f4d-47cd-ac99-22f1723bd186 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:30.382446 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6f52bc5f-8f4d-47cd-ac99-22f1723bd186 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:30.382446 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6f52bc5f-8f4d-47cd-ac99-22f1723bd186 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:30.382446 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6f52bc5f-8f4d-47cd-ac99-22f1723bd186 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:30.510026 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-6f52bc5f-8f4d-47cd-ac99-22f1723bd186 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:30.517803 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-6f52bc5f-8f4d-47cd-ac99-22f1723bd186 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:30.519292 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-6f52bc5f-8f4d-47cd-ac99-22f1723bd186 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:30.520445 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-6f52bc5f-8f4d-47cd-ac99-22f1723bd186 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1727 microversion: 2.20 time: 0.157613 Oct 28 09:53:30.521484 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 347/671] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:53:30 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:31.064595 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-a3c0022c-431c-4263-ac23-da6c27b3f85a req-d989e385-a14e-45dd-bd4e-4c706b5b6b8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b49b31e1-36d8-4096-a5fc-b2d46ef922eb", "name": "network-vif-deleted", "tag": "b51e7b00-09ad-41ca-b851-00805473b75a"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:31.066299 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:53:31.066299 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:53:31.074760 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-a3c0022c-431c-4263-ac23-da6c27b3f85a req-d989e385-a14e-45dd-bd4e-4c706b5b6b8c service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:31.075548 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-a3c0022c-431c-4263-ac23-da6c27b3f85a req-d989e385-a14e-45dd-bd4e-4c706b5b6b8c service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:31.088298 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-a3c0022c-431c-4263-ac23-da6c27b3f85a req-d989e385-a14e-45dd-bd4e-4c706b5b6b8c service nova] Creating event network-vif-deleted:b51e7b00-09ad-41ca-b851-00805473b75a for instance b49b31e1-36d8-4096-a5fc-b2d46ef922eb on hv-cinder-81571 Oct 28 09:53:31.093694 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-a3c0022c-431c-4263-ac23-da6c27b3f85a req-d989e385-a14e-45dd-bd4e-4c706b5b6b8c service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032928 Oct 28 09:53:31.094299 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 325/672] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:53:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:31.177287 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-14e5e9d6-b5a1-4bfe-8b5b-d01983d3ec13 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:31.178865 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-14e5e9d6-b5a1-4bfe-8b5b-d01983d3ec13 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:31.187702 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-14e5e9d6-b5a1-4bfe-8b5b-d01983d3ec13 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:31.188588 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-14e5e9d6-b5a1-4bfe-8b5b-d01983d3ec13 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:31.189498 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-14e5e9d6-b5a1-4bfe-8b5b-d01983d3ec13 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:31.190022 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-14e5e9d6-b5a1-4bfe-8b5b-d01983d3ec13 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:31.337810 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-14e5e9d6-b5a1-4bfe-8b5b-d01983d3ec13 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:31.346233 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-14e5e9d6-b5a1-4bfe-8b5b-d01983d3ec13 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f" status: 200 len: 1365 microversion: 2.1 time: 0.176933 Oct 28 09:53:31.346895 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 348/673] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:31 2021] GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:31.541707 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-f815fff3-4381-4849-b9fc-c99c4b4d288e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:31.542718 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-f815fff3-4381-4849-b9fc-c99c4b4d288e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:31.549489 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f815fff3-4381-4849-b9fc-c99c4b4d288e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:31.550044 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f815fff3-4381-4849-b9fc-c99c4b4d288e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:31.551907 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f815fff3-4381-4849-b9fc-c99c4b4d288e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:31.552279 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f815fff3-4381-4849-b9fc-c99c4b4d288e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:31.589280 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f815fff3-4381-4849-b9fc-c99c4b4d288e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:31.589827 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f815fff3-4381-4849-b9fc-c99c4b4d288e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:31.590274 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.objects.instance [None req-f815fff3-4381-4849-b9fc-c99c4b4d288e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lazy-loading 'fault' on Instance uuid b49b31e1-36d8-4096-a5fc-b2d46ef922eb {{(pid=123068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 09:53:31.635051 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-f815fff3-4381-4849-b9fc-c99c4b4d288e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:31.645011 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-f815fff3-4381-4849-b9fc-c99c4b4d288e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:31.646543 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-f815fff3-4381-4849-b9fc-c99c4b4d288e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:31.649667 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-f815fff3-4381-4849-b9fc-c99c4b4d288e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 200 len: 1376 microversion: 2.20 time: 0.113376 Oct 28 09:53:31.655710 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 326/674] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:53:31 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 1376 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:32.363412 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-b8d3fc0e-173c-4142-9eab-a82a135eb604 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:32.364802 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-b8d3fc0e-173c-4142-9eab-a82a135eb604 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:32.372538 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b8d3fc0e-173c-4142-9eab-a82a135eb604 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:32.373011 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b8d3fc0e-173c-4142-9eab-a82a135eb604 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:32.373847 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b8d3fc0e-173c-4142-9eab-a82a135eb604 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:32.374284 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b8d3fc0e-173c-4142-9eab-a82a135eb604 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:32.541947 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-b8d3fc0e-173c-4142-9eab-a82a135eb604 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:32.549805 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-b8d3fc0e-173c-4142-9eab-a82a135eb604 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f" status: 200 len: 1365 microversion: 2.1 time: 0.189953 Oct 28 09:53:32.550409 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 349/675] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:32 2021] GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f => generated 1365 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:32.679882 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-dabba01e-9094-4784-b0e2-f15331d4cc97 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:32.680492 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-dabba01e-9094-4784-b0e2-f15331d4cc97 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:32.688373 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-dabba01e-9094-4784-b0e2-f15331d4cc97 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:32.688871 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-dabba01e-9094-4784-b0e2-f15331d4cc97 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:32.690068 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-dabba01e-9094-4784-b0e2-f15331d4cc97 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:32.690068 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-dabba01e-9094-4784-b0e2-f15331d4cc97 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:32.704055 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.wsgi [None req-dabba01e-9094-4784-b0e2-f15331d4cc97 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] HTTP exception thrown: Instance b49b31e1-36d8-4096-a5fc-b2d46ef922eb could not be found. Oct 28 09:53:32.704676 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-dabba01e-9094-4784-b0e2-f15331d4cc97 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Returning 404 to user: Instance b49b31e1-36d8-4096-a5fc-b2d46ef922eb could not be found. {{(pid=123068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:53:32.705491 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-dabba01e-9094-4784-b0e2-f15331d4cc97 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 404 len: 111 microversion: 2.20 time: 0.031652 Oct 28 09:53:32.706027 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 327/676] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:53:32 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 09:53:32.714792 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-bdbea891-ab5c-4fe9-91df-b92ad3c94dd2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '.version_select at 0x7fe12133c670>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:32.771202 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-bdbea891-ab5c-4fe9-91df-b92ad3c94dd2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1154370673" status: 204 len: 0 microversion: 2.20 time: 0.060114 Oct 28 09:53:32.771900 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 350/677] 10.222.0.104 () {60 vars in 1266 bytes} [Thu Oct 28 09:53:32 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1154370673 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 09:53:33.574027 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-b6f927c5-fdd3-457a-97c3-44eee94eb5fb tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:33.575325 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-b6f927c5-fdd3-457a-97c3-44eee94eb5fb tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:33.582333 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b6f927c5-fdd3-457a-97c3-44eee94eb5fb tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:33.582333 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b6f927c5-fdd3-457a-97c3-44eee94eb5fb tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:33.582657 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b6f927c5-fdd3-457a-97c3-44eee94eb5fb tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:33.583182 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b6f927c5-fdd3-457a-97c3-44eee94eb5fb tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:33.743041 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-5f39f5d3-bc09-49d3-ae4f-df078a3182e2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'create', calling method: .version_select at 0x7fe1213613a0>, body: {"keypair": {"name": "tempest-keypair-1278874634"}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:33.763640 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.quota [None req-5f39f5d3-bc09-49d3-ae4f-df078a3182e2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Getting quotas for project 137c34c5941c4c86801a0e6b8b5c2f67. Resources: {'key_pairs'} {{(pid=123069) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 09:53:33.767034 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-b6f927c5-fdd3-457a-97c3-44eee94eb5fb tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:33.767864 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.quota [None req-5f39f5d3-bc09-49d3-ae4f-df078a3182e2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Getting quotas for user 2dc1f105c9714526a2a0fb7b51d93102 and project 137c34c5941c4c86801a0e6b8b5c2f67. Resources: {'key_pairs'} {{(pid=123069) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 09:53:33.776758 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-b6f927c5-fdd3-457a-97c3-44eee94eb5fb tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f" status: 200 len: 1365 microversion: 2.1 time: 0.207736 Oct 28 09:53:33.785121 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 328/678] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:33 2021] GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:34.186813 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.quota [None req-5f39f5d3-bc09-49d3-ae4f-df078a3182e2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Getting quotas for project 137c34c5941c4c86801a0e6b8b5c2f67. Resources: {'key_pairs'} {{(pid=123069) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 09:53:34.191907 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.quota [None req-5f39f5d3-bc09-49d3-ae4f-df078a3182e2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Getting quotas for user 2dc1f105c9714526a2a0fb7b51d93102 and project 137c34c5941c4c86801a0e6b8b5c2f67. Resources: {'key_pairs'} {{(pid=123069) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 09:53:34.212586 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-5f39f5d3-bc09-49d3-ae4f-df078a3182e2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.472136 Oct 28 09:53:34.222682 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 351/679] 10.222.0.104 () {62 vars in 1203 bytes} [Thu Oct 28 09:53:33 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 484 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Oct 28 09:53:34.312457 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-d4d9695f-b625-4381-a09f-a67807aa40a3 req-f1bd136d-b972-4fbc-beb1-f565c5357e49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "914bc218-ac76-4448-82e3-f4059c8f8a8f", "name": "network-vif-plugged", "status": "completed", "tag": "58893e81-1ce4-483e-b6b0-b386c74b972a"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:34.317568 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:53:34.317568 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:53:34.322223 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-d4d9695f-b625-4381-a09f-a67807aa40a3 req-f1bd136d-b972-4fbc-beb1-f565c5357e49 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:34.322712 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-d4d9695f-b625-4381-a09f-a67807aa40a3 req-f1bd136d-b972-4fbc-beb1-f565c5357e49 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:34.335743 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-d4d9695f-b625-4381-a09f-a67807aa40a3 req-f1bd136d-b972-4fbc-beb1-f565c5357e49 service nova] Creating event network-vif-plugged:58893e81-1ce4-483e-b6b0-b386c74b972a for instance 914bc218-ac76-4448-82e3-f4059c8f8a8f on hv-cinder-81571 Oct 28 09:53:34.340853 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-d4d9695f-b625-4381-a09f-a67807aa40a3 req-f1bd136d-b972-4fbc-beb1-f565c5357e49 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032057 Oct 28 09:53:34.341444 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 329/680] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:53:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:34.794213 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-eaad09af-acc2-47ea-97ae-6054de4f30f8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:34.795462 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-eaad09af-acc2-47ea-97ae-6054de4f30f8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:34.802582 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-eaad09af-acc2-47ea-97ae-6054de4f30f8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:34.803952 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-eaad09af-acc2-47ea-97ae-6054de4f30f8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:34.804799 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-eaad09af-acc2-47ea-97ae-6054de4f30f8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:34.805236 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-eaad09af-acc2-47ea-97ae-6054de4f30f8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:35.008827 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-eaad09af-acc2-47ea-97ae-6054de4f30f8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:35.018525 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-eaad09af-acc2-47ea-97ae-6054de4f30f8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f" status: 200 len: 1365 microversion: 2.1 time: 0.228437 Oct 28 09:53:35.019405 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 352/681] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:34 2021] GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f => generated 1365 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:36.306067 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-cc8470f5-9ccd-4935-8872-349608e1ed10 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:36.306797 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-cc8470f5-9ccd-4935-8872-349608e1ed10 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:36.312999 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cc8470f5-9ccd-4935-8872-349608e1ed10 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:36.313476 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cc8470f5-9ccd-4935-8872-349608e1ed10 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:36.314209 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cc8470f5-9ccd-4935-8872-349608e1ed10 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:36.314638 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cc8470f5-9ccd-4935-8872-349608e1ed10 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:36.536612 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-cc8470f5-9ccd-4935-8872-349608e1ed10 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:36.544641 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-cc8470f5-9ccd-4935-8872-349608e1ed10 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f" status: 200 len: 1365 microversion: 2.1 time: 0.512713 Oct 28 09:53:36.545229 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 330/682] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:36 2021] GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f => generated 1365 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:37.471212 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-1bded337-1b04-4ace-841c-b8ac013da1da tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1527644952", "imageRef": "623b30fc-1d92-46d9-b556-b9b963f3d76c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "260cb37c-589d-4ef2-92eb-ce6dad8a9c4c"}], "security_groups": [{"name": "tempest-securitygroup--226033764"}], "key_name": "tempest-keypair-1278874634", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:37.562345 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-5551a643-c571-44dc-8da5-dca36c4f88da tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:37.562962 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-5551a643-c571-44dc-8da5-dca36c4f88da tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:37.569576 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5551a643-c571-44dc-8da5-dca36c4f88da tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:37.570304 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5551a643-c571-44dc-8da5-dca36c4f88da tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:37.571129 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5551a643-c571-44dc-8da5-dca36c4f88da tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:37.571565 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5551a643-c571-44dc-8da5-dca36c4f88da tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:37.600145 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.network.neutron [None req-1bded337-1b04-4ace-841c-b8ac013da1da tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] validate_networks() for [('260cb37c-589d-4ef2-92eb-ce6dad8a9c4c', None, None, None, None, None)] {{(pid=123069) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 09:53:37.808321 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-5551a643-c571-44dc-8da5-dca36c4f88da tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:37.816223 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-5551a643-c571-44dc-8da5-dca36c4f88da tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f" status: 200 len: 1550 microversion: 2.1 time: 0.257930 Oct 28 09:53:37.828321 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 331/683] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:37 2021] GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f => generated 1550 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:37.833182 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-01a3ec0f-4662-4e90-94f1-e8b24717bd9b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:37.833746 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-01a3ec0f-4662-4e90-94f1-e8b24717bd9b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:37.841379 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-01a3ec0f-4662-4e90-94f1-e8b24717bd9b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:37.843964 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-01a3ec0f-4662-4e90-94f1-e8b24717bd9b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:37.844706 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-01a3ec0f-4662-4e90-94f1-e8b24717bd9b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:37.845139 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-01a3ec0f-4662-4e90-94f1-e8b24717bd9b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:37.982545 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-01a3ec0f-4662-4e90-94f1-e8b24717bd9b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.152896 Oct 28 09:53:37.983235 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 332/684] 10.222.0.104 () {58 vars in 1279 bytes} [Thu Oct 28 09:53:37 2021] GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/os-interface => generated 284 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:38.311075 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-1bded337-1b04-4ace-841c-b8ac013da1da tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Flavor limits 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:53:38.311503 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-1bded337-1b04-4ace-841c-b8ac013da1da tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Image limits 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:53:38.311975 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-1bded337-1b04-4ace-841c-b8ac013da1da tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Flavor pref 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:53:38.312411 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-1bded337-1b04-4ace-841c-b8ac013da1da tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Image pref 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:53:38.312850 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-1bded337-1b04-4ace-841c-b8ac013da1da tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:53:38.324732 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1bded337-1b04-4ace-841c-b8ac013da1da tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:38.325302 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1bded337-1b04-4ace-841c-b8ac013da1da tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:38.326167 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1bded337-1b04-4ace-841c-b8ac013da1da tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:38.326623 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1bded337-1b04-4ace-841c-b8ac013da1da tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:38.345591 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.quota [None req-1bded337-1b04-4ace-841c-b8ac013da1da tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Getting quotas for project 137c34c5941c4c86801a0e6b8b5c2f67. Resources: {'ram', 'cores', 'instances'} {{(pid=123069) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 09:53:38.349965 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.quota [None req-1bded337-1b04-4ace-841c-b8ac013da1da tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Getting quotas for user 2dc1f105c9714526a2a0fb7b51d93102 and project 137c34c5941c4c86801a0e6b8b5c2f67. Resources: {'ram', 'cores', 'instances'} {{(pid=123069) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 09:53:38.362172 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-1bded337-1b04-4ace-841c-b8ac013da1da tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Going to run 1 instances... {{(pid=123069) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 09:53:38.364448 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-1bded337-1b04-4ace-841c-b8ac013da1da tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='623b30fc-1d92-46d9-b556-b9b963f3d76c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 09:53:38.509317 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-1bded337-1b04-4ace-841c-b8ac013da1da tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.20 time: 1.268913 Oct 28 09:53:38.510326 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 353/685] 10.222.0.104 () {62 vars in 1192 bytes} [Thu Oct 28 09:53:37 2021] POST /compute/v2.1/servers => generated 403 bytes in 1270 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 28 09:53:38.523744 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-bcc1af92-5d04-458f-94ce-4ec38f384856 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:38.524336 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-bcc1af92-5d04-458f-94ce-4ec38f384856 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:38.616831 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-bcc1af92-5d04-458f-94ce-4ec38f384856 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:38.627590 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-bcc1af92-5d04-458f-94ce-4ec38f384856 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:38.628511 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-bcc1af92-5d04-458f-94ce-4ec38f384856 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:38.629988 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-bcc1af92-5d04-458f-94ce-4ec38f384856 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1286 microversion: 2.20 time: 0.112209 Oct 28 09:53:38.631112 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 333/686] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:53:38 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1286 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:39.565476 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-b62d497c-11e9-48dc-81ae-60bb9d21d345 req-c34d72ca-5864-4752-b372-7322daf8368f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "914bc218-ac76-4448-82e3-f4059c8f8a8f", "tag": "58893e81-1ce4-483e-b6b0-b386c74b972a"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:39.567884 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-8a8a1c89-2084-481d-b934-7fe26804eb07 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:39.568747 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:53:39.568747 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:53:39.570547 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-8a8a1c89-2084-481d-b934-7fe26804eb07 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:39.581695 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-b62d497c-11e9-48dc-81ae-60bb9d21d345 req-c34d72ca-5864-4752-b372-7322daf8368f service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:39.582461 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-b62d497c-11e9-48dc-81ae-60bb9d21d345 req-c34d72ca-5864-4752-b372-7322daf8368f service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:39.582887 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8a8a1c89-2084-481d-b934-7fe26804eb07 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:39.583669 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8a8a1c89-2084-481d-b934-7fe26804eb07 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:39.593948 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8a8a1c89-2084-481d-b934-7fe26804eb07 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:39.594811 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8a8a1c89-2084-481d-b934-7fe26804eb07 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:39.599986 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-b62d497c-11e9-48dc-81ae-60bb9d21d345 req-c34d72ca-5864-4752-b372-7322daf8368f service nova] Creating event network-changed:58893e81-1ce4-483e-b6b0-b386c74b972a for instance 914bc218-ac76-4448-82e3-f4059c8f8a8f on hv-cinder-81571 Oct 28 09:53:39.607084 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-b62d497c-11e9-48dc-81ae-60bb9d21d345 req-c34d72ca-5864-4752-b372-7322daf8368f service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047753 Oct 28 09:53:39.608488 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 334/687] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:53:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:53:39.653030 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-a484bc96-db6c-4523-b231-06f16b5ec62a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:39.654109 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-a484bc96-db6c-4523-b231-06f16b5ec62a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:39.660518 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a484bc96-db6c-4523-b231-06f16b5ec62a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:39.661011 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a484bc96-db6c-4523-b231-06f16b5ec62a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:39.661821 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a484bc96-db6c-4523-b231-06f16b5ec62a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:39.662252 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a484bc96-db6c-4523-b231-06f16b5ec62a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:39.677932 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-8a8a1c89-2084-481d-b934-7fe26804eb07 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action" status: 200 len: 14 microversion: 2.1 time: 0.122706 Oct 28 09:53:39.681020 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 354/688] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:53:39 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:53:39.761538 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-a484bc96-db6c-4523-b231-06f16b5ec62a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:39.775325 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-a484bc96-db6c-4523-b231-06f16b5ec62a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:39.778745 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-a484bc96-db6c-4523-b231-06f16b5ec62a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:39.779925 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-a484bc96-db6c-4523-b231-06f16b5ec62a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1290 microversion: 2.20 time: 0.133965 Oct 28 09:53:39.781524 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 335/689] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:53:39 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1290 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:53:40.696137 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-d47733fa-9eec-4787-bf9b-0a2bdfa84eb2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:40.696137 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-d47733fa-9eec-4787-bf9b-0a2bdfa84eb2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:40.702016 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d47733fa-9eec-4787-bf9b-0a2bdfa84eb2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:40.702461 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d47733fa-9eec-4787-bf9b-0a2bdfa84eb2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:40.703246 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d47733fa-9eec-4787-bf9b-0a2bdfa84eb2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:40.704305 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d47733fa-9eec-4787-bf9b-0a2bdfa84eb2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:40.766802 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-d47733fa-9eec-4787-bf9b-0a2bdfa84eb2 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action" status: 200 len: 14 microversion: 2.1 time: 0.078280 Oct 28 09:53:40.767432 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 355/690] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:53:40 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:53:40.798495 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-488ab33a-00b8-4a2e-b304-809fadf7bc4e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:40.799098 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-488ab33a-00b8-4a2e-b304-809fadf7bc4e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:40.805403 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-488ab33a-00b8-4a2e-b304-809fadf7bc4e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:40.805845 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-488ab33a-00b8-4a2e-b304-809fadf7bc4e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:40.806676 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-488ab33a-00b8-4a2e-b304-809fadf7bc4e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:40.807152 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-488ab33a-00b8-4a2e-b304-809fadf7bc4e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:40.872110 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-488ab33a-00b8-4a2e-b304-809fadf7bc4e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:40.882270 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-488ab33a-00b8-4a2e-b304-809fadf7bc4e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:40.883758 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-488ab33a-00b8-4a2e-b304-809fadf7bc4e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:40.884924 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-488ab33a-00b8-4a2e-b304-809fadf7bc4e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1338 microversion: 2.20 time: 0.090561 Oct 28 09:53:40.885511 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 336/691] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:53:40 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1338 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:41.782391 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-9d1d1d51-7126-4679-b87f-8ec846c4175c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:41.784960 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-9d1d1d51-7126-4679-b87f-8ec846c4175c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:41.797820 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9d1d1d51-7126-4679-b87f-8ec846c4175c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:41.800116 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9d1d1d51-7126-4679-b87f-8ec846c4175c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:41.802852 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9d1d1d51-7126-4679-b87f-8ec846c4175c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:41.804346 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9d1d1d51-7126-4679-b87f-8ec846c4175c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:41.891018 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-9d1d1d51-7126-4679-b87f-8ec846c4175c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action" status: 200 len: 14 microversion: 2.1 time: 0.114704 Oct 28 09:53:41.892725 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 356/692] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:53:41 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:53:41.904539 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-daa931bb-b362-4990-9293-3dbfd2774271 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:41.906703 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-daa931bb-b362-4990-9293-3dbfd2774271 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:41.915891 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-daa931bb-b362-4990-9293-3dbfd2774271 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:41.920058 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-daa931bb-b362-4990-9293-3dbfd2774271 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:41.920058 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-daa931bb-b362-4990-9293-3dbfd2774271 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:41.920058 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-daa931bb-b362-4990-9293-3dbfd2774271 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:42.157052 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-daa931bb-b362-4990-9293-3dbfd2774271 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:42.168561 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-daa931bb-b362-4990-9293-3dbfd2774271 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:42.170511 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-daa931bb-b362-4990-9293-3dbfd2774271 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:42.172017 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-daa931bb-b362-4990-9293-3dbfd2774271 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1411 microversion: 2.20 time: 0.271441 Oct 28 09:53:42.172955 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 337/693] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:53:41 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1411 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:42.907753 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-3a8f4da0-56a4-4ca0-b578-453a38cdfcec tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:42.909703 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-3a8f4da0-56a4-4ca0-b578-453a38cdfcec tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:42.920032 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-ed23ff31-a5c9-44a9-8623-f1768c63e74a req-4c3060d3-a867-4b60-8d5b-59f8a1a7a47b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f18b00b-bb81-40c2-96fc-aeb3627b6028", "tag": "15410dad-2493-48fa-8bb6-cbde6b1a0ab5"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:42.920719 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:53:42.920719 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:53:42.937040 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-ed23ff31-a5c9-44a9-8623-f1768c63e74a req-4c3060d3-a867-4b60-8d5b-59f8a1a7a47b service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:42.937705 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-ed23ff31-a5c9-44a9-8623-f1768c63e74a req-4c3060d3-a867-4b60-8d5b-59f8a1a7a47b service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:42.938207 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3a8f4da0-56a4-4ca0-b578-453a38cdfcec tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:42.938768 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3a8f4da0-56a4-4ca0-b578-453a38cdfcec tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:42.939665 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3a8f4da0-56a4-4ca0-b578-453a38cdfcec tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:42.940331 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3a8f4da0-56a4-4ca0-b578-453a38cdfcec tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:42.952755 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-ed23ff31-a5c9-44a9-8623-f1768c63e74a req-4c3060d3-a867-4b60-8d5b-59f8a1a7a47b service nova] Creating event network-changed:15410dad-2493-48fa-8bb6-cbde6b1a0ab5 for instance 4f18b00b-bb81-40c2-96fc-aeb3627b6028 on hv-cinder-81571 Oct 28 09:53:42.959486 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-ed23ff31-a5c9-44a9-8623-f1768c63e74a req-4c3060d3-a867-4b60-8d5b-59f8a1a7a47b service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046424 Oct 28 09:53:42.960751 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 338/694] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:53:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:53:43.024492 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-3a8f4da0-56a4-4ca0-b578-453a38cdfcec tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action" status: 200 len: 14 microversion: 2.1 time: 0.123576 Oct 28 09:53:43.027897 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 357/695] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:53:42 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:53:43.192889 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-f014c984-76ea-4c05-853d-69f893b6e4a2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:43.194583 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-f014c984-76ea-4c05-853d-69f893b6e4a2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:43.201927 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f014c984-76ea-4c05-853d-69f893b6e4a2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:43.202981 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f014c984-76ea-4c05-853d-69f893b6e4a2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:43.203680 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f014c984-76ea-4c05-853d-69f893b6e4a2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:43.204216 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f014c984-76ea-4c05-853d-69f893b6e4a2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:43.407980 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-f014c984-76ea-4c05-853d-69f893b6e4a2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:43.419695 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-f014c984-76ea-4c05-853d-69f893b6e4a2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:43.420870 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-f014c984-76ea-4c05-853d-69f893b6e4a2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:43.422520 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-f014c984-76ea-4c05-853d-69f893b6e4a2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1411 microversion: 2.20 time: 0.234368 Oct 28 09:53:43.423089 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 339/696] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:53:43 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1411 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:44.035740 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-3827558a-05e7-484b-b962-fb6bda96f908 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:44.036782 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-3827558a-05e7-484b-b962-fb6bda96f908 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:44.043882 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3827558a-05e7-484b-b962-fb6bda96f908 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:44.044324 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3827558a-05e7-484b-b962-fb6bda96f908 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:44.045131 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3827558a-05e7-484b-b962-fb6bda96f908 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:44.045562 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3827558a-05e7-484b-b962-fb6bda96f908 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:44.106559 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-3827558a-05e7-484b-b962-fb6bda96f908 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action" status: 200 len: 14 microversion: 2.1 time: 0.074636 Oct 28 09:53:44.107254 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 358/697] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:53:44 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:53:44.445001 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-709dec33-6fb6-43fa-9184-bf25f7ab265a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:44.445813 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-709dec33-6fb6-43fa-9184-bf25f7ab265a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:44.451713 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-709dec33-6fb6-43fa-9184-bf25f7ab265a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:44.452226 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-709dec33-6fb6-43fa-9184-bf25f7ab265a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:44.453103 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-709dec33-6fb6-43fa-9184-bf25f7ab265a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:44.453517 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-709dec33-6fb6-43fa-9184-bf25f7ab265a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:44.588834 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-709dec33-6fb6-43fa-9184-bf25f7ab265a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:44.596996 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-709dec33-6fb6-43fa-9184-bf25f7ab265a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:44.598484 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-709dec33-6fb6-43fa-9184-bf25f7ab265a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:44.599589 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-709dec33-6fb6-43fa-9184-bf25f7ab265a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1411 microversion: 2.20 time: 0.161789 Oct 28 09:53:44.610390 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 340/698] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:53:44 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1411 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:53:45.117947 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-e3911439-13a4-4d37-b6c4-40ea280f8d7d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:45.118906 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-e3911439-13a4-4d37-b6c4-40ea280f8d7d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:45.125955 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e3911439-13a4-4d37-b6c4-40ea280f8d7d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:45.126429 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e3911439-13a4-4d37-b6c4-40ea280f8d7d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:45.127266 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e3911439-13a4-4d37-b6c4-40ea280f8d7d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:45.127697 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e3911439-13a4-4d37-b6c4-40ea280f8d7d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:45.190633 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-e3911439-13a4-4d37-b6c4-40ea280f8d7d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action" status: 200 len: 14 microversion: 2.1 time: 0.076981 Oct 28 09:53:45.191451 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 359/699] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:53:45 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:53:45.618070 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-f7755cac-771e-42a4-b700-26ad17d19244 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:45.618675 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-f7755cac-771e-42a4-b700-26ad17d19244 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:45.625186 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f7755cac-771e-42a4-b700-26ad17d19244 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:45.625590 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f7755cac-771e-42a4-b700-26ad17d19244 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:45.626367 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f7755cac-771e-42a4-b700-26ad17d19244 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:45.626801 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f7755cac-771e-42a4-b700-26ad17d19244 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:45.751075 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-f7755cac-771e-42a4-b700-26ad17d19244 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:45.759930 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-f7755cac-771e-42a4-b700-26ad17d19244 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:45.761441 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-f7755cac-771e-42a4-b700-26ad17d19244 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:45.762542 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-f7755cac-771e-42a4-b700-26ad17d19244 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1411 microversion: 2.20 time: 0.148232 Oct 28 09:53:45.763083 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 341/700] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:53:45 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1411 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:46.203181 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-230d65a3-8842-4fb3-a86e-463ac568323c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:46.204446 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-230d65a3-8842-4fb3-a86e-463ac568323c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:46.211905 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-230d65a3-8842-4fb3-a86e-463ac568323c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:46.212500 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-230d65a3-8842-4fb3-a86e-463ac568323c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:46.213313 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-230d65a3-8842-4fb3-a86e-463ac568323c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:46.213746 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-230d65a3-8842-4fb3-a86e-463ac568323c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:46.284018 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-230d65a3-8842-4fb3-a86e-463ac568323c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action" status: 200 len: 14 microversion: 2.1 time: 0.084916 Oct 28 09:53:46.284860 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 360/701] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:53:46 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:53:46.779456 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-919d1641-3eba-413d-a5ee-2131fdd7c07b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:46.780272 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-919d1641-3eba-413d-a5ee-2131fdd7c07b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:46.786533 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-919d1641-3eba-413d-a5ee-2131fdd7c07b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:46.786981 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-919d1641-3eba-413d-a5ee-2131fdd7c07b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:46.788478 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-919d1641-3eba-413d-a5ee-2131fdd7c07b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:46.788943 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-919d1641-3eba-413d-a5ee-2131fdd7c07b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:46.919238 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-919d1641-3eba-413d-a5ee-2131fdd7c07b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:46.927610 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-919d1641-3eba-413d-a5ee-2131fdd7c07b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:46.929171 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-919d1641-3eba-413d-a5ee-2131fdd7c07b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:46.930282 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-919d1641-3eba-413d-a5ee-2131fdd7c07b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1411 microversion: 2.20 time: 0.154664 Oct 28 09:53:46.930847 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 342/702] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:53:46 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1411 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:47.295602 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-9e03d676-e389-4cf0-bb82-e77909ddbe69 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:47.297133 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-9e03d676-e389-4cf0-bb82-e77909ddbe69 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:47.306297 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9e03d676-e389-4cf0-bb82-e77909ddbe69 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:47.306785 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9e03d676-e389-4cf0-bb82-e77909ddbe69 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:47.307939 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9e03d676-e389-4cf0-bb82-e77909ddbe69 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:47.308375 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9e03d676-e389-4cf0-bb82-e77909ddbe69 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:47.375847 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-9e03d676-e389-4cf0-bb82-e77909ddbe69 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action" status: 200 len: 14 microversion: 2.1 time: 0.084084 Oct 28 09:53:47.376501 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 361/703] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:53:47 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:53:47.955379 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-88ae883d-188e-4af3-867a-3948701f516d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:47.956003 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-88ae883d-188e-4af3-867a-3948701f516d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:47.962880 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-88ae883d-188e-4af3-867a-3948701f516d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:47.963325 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-88ae883d-188e-4af3-867a-3948701f516d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:47.964093 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-88ae883d-188e-4af3-867a-3948701f516d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:47.964526 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-88ae883d-188e-4af3-867a-3948701f516d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:48.101180 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-88ae883d-188e-4af3-867a-3948701f516d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:48.110869 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-88ae883d-188e-4af3-867a-3948701f516d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:48.113888 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-88ae883d-188e-4af3-867a-3948701f516d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:48.115937 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-88ae883d-188e-4af3-867a-3948701f516d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1411 microversion: 2.20 time: 0.163894 Oct 28 09:53:48.116967 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 343/704] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:53:47 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1411 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:48.387650 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-fde4502d-ec3d-4296-ad78-e77ec20fcc36 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:48.388703 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-fde4502d-ec3d-4296-ad78-e77ec20fcc36 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:48.395852 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fde4502d-ec3d-4296-ad78-e77ec20fcc36 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:48.396297 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fde4502d-ec3d-4296-ad78-e77ec20fcc36 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:48.397799 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fde4502d-ec3d-4296-ad78-e77ec20fcc36 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:48.398265 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fde4502d-ec3d-4296-ad78-e77ec20fcc36 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:48.416481 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-735b1267-258d-41d5-bb35-c438be55cc4f req-68dc606c-9cb5-48cb-93b9-5dc21b90e434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f18b00b-bb81-40c2-96fc-aeb3627b6028", "name": "network-vif-plugged", "status": "completed", "tag": "15410dad-2493-48fa-8bb6-cbde6b1a0ab5"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:48.418315 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:53:48.418315 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:53:48.430393 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-735b1267-258d-41d5-bb35-c438be55cc4f req-68dc606c-9cb5-48cb-93b9-5dc21b90e434 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:48.430829 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-735b1267-258d-41d5-bb35-c438be55cc4f req-68dc606c-9cb5-48cb-93b9-5dc21b90e434 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:48.442156 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-735b1267-258d-41d5-bb35-c438be55cc4f req-68dc606c-9cb5-48cb-93b9-5dc21b90e434 service nova] Creating event network-vif-plugged:15410dad-2493-48fa-8bb6-cbde6b1a0ab5 for instance 4f18b00b-bb81-40c2-96fc-aeb3627b6028 on hv-cinder-81571 Oct 28 09:53:48.451576 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-735b1267-258d-41d5-bb35-c438be55cc4f req-68dc606c-9cb5-48cb-93b9-5dc21b90e434 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038689 Oct 28 09:53:48.452188 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 344/705] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:53:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:53:48.464613 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-fde4502d-ec3d-4296-ad78-e77ec20fcc36 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action" status: 200 len: 14 microversion: 2.1 time: 0.080953 Oct 28 09:53:48.465301 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 362/706] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:53:48 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 09:53:49.136852 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-2cd7844d-3174-43ad-888b-bc7d9a261fb3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:49.137451 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-2cd7844d-3174-43ad-888b-bc7d9a261fb3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:49.143675 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2cd7844d-3174-43ad-888b-bc7d9a261fb3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:49.144106 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2cd7844d-3174-43ad-888b-bc7d9a261fb3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:49.144901 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2cd7844d-3174-43ad-888b-bc7d9a261fb3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:49.145325 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2cd7844d-3174-43ad-888b-bc7d9a261fb3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:49.279476 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-2cd7844d-3174-43ad-888b-bc7d9a261fb3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:49.288508 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-2cd7844d-3174-43ad-888b-bc7d9a261fb3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:49.290049 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-2cd7844d-3174-43ad-888b-bc7d9a261fb3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:49.291165 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-2cd7844d-3174-43ad-888b-bc7d9a261fb3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1411 microversion: 2.20 time: 0.160011 Oct 28 09:53:49.291728 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 345/707] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:53:49 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1411 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:53:49.478023 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-4abccddd-7395-4606-9862-05e508706fab tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:49.479019 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-4abccddd-7395-4606-9862-05e508706fab tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:49.486080 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4abccddd-7395-4606-9862-05e508706fab tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:49.486511 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4abccddd-7395-4606-9862-05e508706fab tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:49.487278 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4abccddd-7395-4606-9862-05e508706fab tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:49.487708 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4abccddd-7395-4606-9862-05e508706fab tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:49.570884 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-4abccddd-7395-4606-9862-05e508706fab tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action" status: 200 len: 4832 microversion: 2.1 time: 0.096819 Oct 28 09:53:49.571543 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 363/708] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:53:49 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action => generated 4832 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:50.309538 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-97134d0c-817c-42fe-a051-d510e99319b8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:50.310138 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-97134d0c-817c-42fe-a051-d510e99319b8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:50.316505 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-97134d0c-817c-42fe-a051-d510e99319b8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:50.316986 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-97134d0c-817c-42fe-a051-d510e99319b8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:50.317777 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-97134d0c-817c-42fe-a051-d510e99319b8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:50.318210 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-97134d0c-817c-42fe-a051-d510e99319b8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:50.449890 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-97134d0c-817c-42fe-a051-d510e99319b8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:50.458376 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-97134d0c-817c-42fe-a051-d510e99319b8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:50.460494 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-97134d0c-817c-42fe-a051-d510e99319b8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:50.461691 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-97134d0c-817c-42fe-a051-d510e99319b8 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1603 microversion: 2.20 time: 0.155855 Oct 28 09:53:50.462253 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 346/709] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:53:50 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1603 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:50.480691 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-10cca112-0ddf-4550-9d18-2e9369e78a50 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:50.481286 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-10cca112-0ddf-4550-9d18-2e9369e78a50 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:50.488288 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-10cca112-0ddf-4550-9d18-2e9369e78a50 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:50.488753 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-10cca112-0ddf-4550-9d18-2e9369e78a50 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:50.489522 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-10cca112-0ddf-4550-9d18-2e9369e78a50 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:50.489939 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-10cca112-0ddf-4550-9d18-2e9369e78a50 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:50.582140 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-be47fcba-2089-4d54-bb67-4c6cb1ba4ba9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:50.583081 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-be47fcba-2089-4d54-bb67-4c6cb1ba4ba9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:50.583779 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-10cca112-0ddf-4550-9d18-2e9369e78a50 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.107013 Oct 28 09:53:50.585340 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 364/710] 10.222.0.104 () {60 vars in 1320 bytes} [Thu Oct 28 09:53:50 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:53:50.590559 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-be47fcba-2089-4d54-bb67-4c6cb1ba4ba9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:50.591006 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-be47fcba-2089-4d54-bb67-4c6cb1ba4ba9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:50.591870 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-be47fcba-2089-4d54-bb67-4c6cb1ba4ba9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:50.592503 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-be47fcba-2089-4d54-bb67-4c6cb1ba4ba9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:50.676236 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-be47fcba-2089-4d54-bb67-4c6cb1ba4ba9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action" status: 200 len: 12548 microversion: 2.1 time: 0.098436 Oct 28 09:53:50.677031 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 347/711] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:53:50 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action => generated 12548 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 09:53:50.710430 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-d21b6d1d-b32a-41c9-852d-96535da817df tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1944720348"}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:50.710968 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-d21b6d1d-b32a-41c9-852d-96535da817df tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:50.716943 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d21b6d1d-b32a-41c9-852d-96535da817df tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:50.717375 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d21b6d1d-b32a-41c9-852d-96535da817df tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:50.718136 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d21b6d1d-b32a-41c9-852d-96535da817df tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:50.718558 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d21b6d1d-b32a-41c9-852d-96535da817df tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:50.844882 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.network.security_group_api [None req-d21b6d1d-b32a-41c9-852d-96535da817df tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Removing security group 5cc117c9-e153-4e2c-b2ac-8b040482d5c1 from port cbe862a5-40a7-43ef-b2b3-73aad1487228 Oct 28 09:53:51.274394 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-d21b6d1d-b32a-41c9-852d-96535da817df tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "POST /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232/action" status: 202 len: 0 microversion: 2.1 time: 0.568694 Oct 28 09:53:51.275340 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 365/712] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:53:50 2021] POST /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232/action => generated 0 bytes in 570 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:53:51.292709 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-becc0c74-065d-4a19-bfb9-2f2fb4021252 req-231ced91-5e71-4d37-b302-04782bea1363 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d623582-8352-4294-9aca-086539f32232", "tag": "cbe862a5-40a7-43ef-b2b3-73aad1487228"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:51.294387 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:53:51.294387 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:53:51.311195 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-becc0c74-065d-4a19-bfb9-2f2fb4021252 req-231ced91-5e71-4d37-b302-04782bea1363 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:51.312485 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-becc0c74-065d-4a19-bfb9-2f2fb4021252 req-231ced91-5e71-4d37-b302-04782bea1363 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:51.340881 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-becc0c74-065d-4a19-bfb9-2f2fb4021252 req-231ced91-5e71-4d37-b302-04782bea1363 service nova] Creating event network-changed:cbe862a5-40a7-43ef-b2b3-73aad1487228 for instance 2d623582-8352-4294-9aca-086539f32232 on hv-cinder-81571 Oct 28 09:53:51.350520 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-becc0c74-065d-4a19-bfb9-2f2fb4021252 req-231ced91-5e71-4d37-b302-04782bea1363 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059963 Oct 28 09:53:51.351820 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 348/713] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:53:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:51.687751 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-59c50a39-50ba-49c8-845f-adb15defb7d6 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:51.688711 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-59c50a39-50ba-49c8-845f-adb15defb7d6 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:51.695173 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-59c50a39-50ba-49c8-845f-adb15defb7d6 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:51.695611 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-59c50a39-50ba-49c8-845f-adb15defb7d6 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:51.696400 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-59c50a39-50ba-49c8-845f-adb15defb7d6 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:51.696862 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-59c50a39-50ba-49c8-845f-adb15defb7d6 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:51.784566 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-59c50a39-50ba-49c8-845f-adb15defb7d6 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action" status: 200 len: 18030 microversion: 2.1 time: 0.100795 Oct 28 09:53:51.787884 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 366/714] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:53:51 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action => generated 18030 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:53:52.028975 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-a44d31a2-3ad9-478b-ada3-377707e86821 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:52.029984 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-a44d31a2-3ad9-478b-ada3-377707e86821 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:52.043241 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a44d31a2-3ad9-478b-ada3-377707e86821 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:52.043927 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a44d31a2-3ad9-478b-ada3-377707e86821 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:52.044911 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a44d31a2-3ad9-478b-ada3-377707e86821 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:52.045505 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a44d31a2-3ad9-478b-ada3-377707e86821 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:52.123056 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-a44d31a2-3ad9-478b-ada3-377707e86821 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 14 microversion: 2.20 time: 0.099765 Oct 28 09:53:52.123969 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 349/715] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:53:52 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:52.274902 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [req-0ace63fd-281e-4bdc-bd74-45efe803e559 req-353df8ce-91bb-4e1e-b21e-4f651c7d7119 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f18b00b-bb81-40c2-96fc-aeb3627b6028", "tag": "15410dad-2493-48fa-8bb6-cbde6b1a0ab5"}]} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:52.277076 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:53:52.277076 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 09:53:52.285872 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-0ace63fd-281e-4bdc-bd74-45efe803e559 req-353df8ce-91bb-4e1e-b21e-4f651c7d7119 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:52.286674 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-0ace63fd-281e-4bdc-bd74-45efe803e559 req-353df8ce-91bb-4e1e-b21e-4f651c7d7119 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:52.299461 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.compute.server_external_events [req-0ace63fd-281e-4bdc-bd74-45efe803e559 req-353df8ce-91bb-4e1e-b21e-4f651c7d7119 service nova] Creating event network-changed:15410dad-2493-48fa-8bb6-cbde6b1a0ab5 for instance 4f18b00b-bb81-40c2-96fc-aeb3627b6028 on hv-cinder-81571 Oct 28 09:53:52.305500 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [req-0ace63fd-281e-4bdc-bd74-45efe803e559 req-353df8ce-91bb-4e1e-b21e-4f651c7d7119 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.279264 Oct 28 09:53:52.306417 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 367/716] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:53:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:52.800071 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-b821c0b7-417e-4790-8654-618e8dd8ca38 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:52.801961 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-b821c0b7-417e-4790-8654-618e8dd8ca38 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:52.813100 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b821c0b7-417e-4790-8654-618e8dd8ca38 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:52.813987 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b821c0b7-417e-4790-8654-618e8dd8ca38 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:52.815012 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b821c0b7-417e-4790-8654-618e8dd8ca38 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:52.815665 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b821c0b7-417e-4790-8654-618e8dd8ca38 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:52.901094 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-b821c0b7-417e-4790-8654-618e8dd8ca38 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action" status: 200 len: 19024 microversion: 2.1 time: 0.105773 Oct 28 09:53:52.905953 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 350/717] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:53:52 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action => generated 19024 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:53:52.956399 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-bd7ac86c-9664-4518-bccf-dc709a7be6c6 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:52.957105 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-bd7ac86c-9664-4518-bccf-dc709a7be6c6 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:52.964924 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bd7ac86c-9664-4518-bccf-dc709a7be6c6 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:52.965700 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bd7ac86c-9664-4518-bccf-dc709a7be6c6 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:52.966649 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bd7ac86c-9664-4518-bccf-dc709a7be6c6 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:52.967333 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bd7ac86c-9664-4518-bccf-dc709a7be6c6 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:53.073802 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.objects.instance [None req-bd7ac86c-9664-4518-bccf-dc709a7be6c6 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lazy-loading 'services' on Instance uuid 2d623582-8352-4294-9aca-086539f32232 {{(pid=123069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 09:53:53.137108 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-3e184323-ea04-475c-b858-4542a6a30997 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:53.138319 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-3e184323-ea04-475c-b858-4542a6a30997 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:53.145604 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3e184323-ea04-475c-b858-4542a6a30997 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:53.146178 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3e184323-ea04-475c-b858-4542a6a30997 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:53.147390 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3e184323-ea04-475c-b858-4542a6a30997 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:53.148081 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3e184323-ea04-475c-b858-4542a6a30997 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:53.216504 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-3e184323-ea04-475c-b858-4542a6a30997 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 14 microversion: 2.20 time: 0.084300 Oct 28 09:53:53.217899 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 351/718] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:53:53 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:53.312045 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-bd7ac86c-9664-4518-bccf-dc709a7be6c6 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "DELETE /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232/os-volume_attachments/8ea7b375-edd3-45d2-aacb-aada52e44d43" status: 202 len: 0 microversion: 2.1 time: 0.360055 Oct 28 09:53:53.312919 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 368/719] 10.222.0.104 () {58 vars in 1420 bytes} [Thu Oct 28 09:53:52 2021] DELETE /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232/os-volume_attachments/8ea7b375-edd3-45d2-aacb-aada52e44d43 => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:53:53.322190 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-7ccd81cc-48f4-4983-921c-c3b18245bab9 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:53.323475 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-7ccd81cc-48f4-4983-921c-c3b18245bab9 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:53.331124 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7ccd81cc-48f4-4983-921c-c3b18245bab9 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:53.331567 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7ccd81cc-48f4-4983-921c-c3b18245bab9 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:53.332561 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7ccd81cc-48f4-4983-921c-c3b18245bab9 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:53.332999 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7ccd81cc-48f4-4983-921c-c3b18245bab9 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:53.366873 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-7ccd81cc-48f4-4983-921c-c3b18245bab9 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048845 Oct 28 09:53:53.368174 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 352/720] 10.222.0.104 () {58 vars in 1306 bytes} [Thu Oct 28 09:53:53 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:53:53.368300 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [req-33bb2a78-991c-4da6-9ed1-e1c31ac7b8df req-4abdfa35-85ff-4913-9e93-72365b35549e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d623582-8352-4294-9aca-086539f32232", "tag": "cbe862a5-40a7-43ef-b2b3-73aad1487228"}]} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:53.369105 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:53:53.369105 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 09:53:53.376447 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-33bb2a78-991c-4da6-9ed1-e1c31ac7b8df req-4abdfa35-85ff-4913-9e93-72365b35549e service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:53.376952 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-33bb2a78-991c-4da6-9ed1-e1c31ac7b8df req-4abdfa35-85ff-4913-9e93-72365b35549e service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:53.388180 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.compute.server_external_events [req-33bb2a78-991c-4da6-9ed1-e1c31ac7b8df req-4abdfa35-85ff-4913-9e93-72365b35549e service nova] Creating event network-changed:cbe862a5-40a7-43ef-b2b3-73aad1487228 for instance 2d623582-8352-4294-9aca-086539f32232 on hv-cinder-81571 Oct 28 09:53:53.393430 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [req-33bb2a78-991c-4da6-9ed1-e1c31ac7b8df req-4abdfa35-85ff-4913-9e93-72365b35549e service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030521 Oct 28 09:53:53.394268 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 369/721] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:53:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:53.912860 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-14a3cb28-c475-4f44-ba1e-8efcd3ee3511 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:53.913774 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-14a3cb28-c475-4f44-ba1e-8efcd3ee3511 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:53.920415 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-14a3cb28-c475-4f44-ba1e-8efcd3ee3511 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:53.920881 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-14a3cb28-c475-4f44-ba1e-8efcd3ee3511 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:53.922445 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-14a3cb28-c475-4f44-ba1e-8efcd3ee3511 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:53.922877 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-14a3cb28-c475-4f44-ba1e-8efcd3ee3511 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:54.011231 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-14a3cb28-c475-4f44-ba1e-8efcd3ee3511 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action" status: 200 len: 20985 microversion: 2.1 time: 0.101744 Oct 28 09:53:54.012288 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 353/722] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:53:53 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action => generated 20985 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:53:54.229218 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-b07dfce2-43d9-4756-a982-5d77fe91b198 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:54.230250 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-b07dfce2-43d9-4756-a982-5d77fe91b198 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:54.236970 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b07dfce2-43d9-4756-a982-5d77fe91b198 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:54.237408 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b07dfce2-43d9-4756-a982-5d77fe91b198 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:54.238165 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b07dfce2-43d9-4756-a982-5d77fe91b198 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:54.238585 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b07dfce2-43d9-4756-a982-5d77fe91b198 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:54.306981 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-b07dfce2-43d9-4756-a982-5d77fe91b198 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 14 microversion: 2.20 time: 0.082928 Oct 28 09:53:54.307814 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 370/723] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:53:54 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:54.379420 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-44018100-8477-42d8-bc95-0bd4a5ae9cfe tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:54.380326 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-44018100-8477-42d8-bc95-0bd4a5ae9cfe tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:54.388318 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-44018100-8477-42d8-bc95-0bd4a5ae9cfe tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:54.388803 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-44018100-8477-42d8-bc95-0bd4a5ae9cfe tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:54.389613 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-44018100-8477-42d8-bc95-0bd4a5ae9cfe tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:54.390057 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-44018100-8477-42d8-bc95-0bd4a5ae9cfe tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:54.422164 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-44018100-8477-42d8-bc95-0bd4a5ae9cfe tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047347 Oct 28 09:53:54.422751 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 354/724] 10.222.0.104 () {58 vars in 1306 bytes} [Thu Oct 28 09:53:54 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:55.024356 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-8b983802-337d-4073-a3a9-c80757d700e4 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:55.025425 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-8b983802-337d-4073-a3a9-c80757d700e4 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:55.032367 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8b983802-337d-4073-a3a9-c80757d700e4 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:55.032850 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8b983802-337d-4073-a3a9-c80757d700e4 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:55.033625 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8b983802-337d-4073-a3a9-c80757d700e4 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:55.034054 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8b983802-337d-4073-a3a9-c80757d700e4 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:55.111489 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-8b983802-337d-4073-a3a9-c80757d700e4 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action" status: 200 len: 22969 microversion: 2.1 time: 0.091446 Oct 28 09:53:55.112165 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 371/725] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:53:55 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action => generated 22969 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:53:55.318721 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-13875af7-4308-40eb-ab6b-e722b033b60f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:55.319643 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-13875af7-4308-40eb-ab6b-e722b033b60f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:55.325336 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-13875af7-4308-40eb-ab6b-e722b033b60f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:55.326977 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-13875af7-4308-40eb-ab6b-e722b033b60f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:55.326977 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-13875af7-4308-40eb-ab6b-e722b033b60f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:55.326977 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-13875af7-4308-40eb-ab6b-e722b033b60f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:55.393811 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-13875af7-4308-40eb-ab6b-e722b033b60f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 14 microversion: 2.20 time: 0.079256 Oct 28 09:53:55.394641 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 355/726] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:53:55 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:55.435100 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-71c53309-ed70-4af1-9ca6-e5cd10819666 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:55.436129 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-71c53309-ed70-4af1-9ca6-e5cd10819666 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:55.443135 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-71c53309-ed70-4af1-9ca6-e5cd10819666 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:55.443578 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-71c53309-ed70-4af1-9ca6-e5cd10819666 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:55.444370 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-71c53309-ed70-4af1-9ca6-e5cd10819666 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:55.444990 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-71c53309-ed70-4af1-9ca6-e5cd10819666 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:55.474731 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-71c53309-ed70-4af1-9ca6-e5cd10819666 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043709 Oct 28 09:53:55.475851 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 372/727] 10.222.0.104 () {58 vars in 1306 bytes} [Thu Oct 28 09:53:55 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 09:53:55.486327 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-91107124-1277-4b7e-acbc-3a3dc36cae3f tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:55.486933 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-91107124-1277-4b7e-acbc-3a3dc36cae3f tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:55.494572 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-91107124-1277-4b7e-acbc-3a3dc36cae3f tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:55.495012 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-91107124-1277-4b7e-acbc-3a3dc36cae3f tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:55.495788 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-91107124-1277-4b7e-acbc-3a3dc36cae3f tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:55.496214 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-91107124-1277-4b7e-acbc-3a3dc36cae3f tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:55.573815 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.wsgi [None req-91107124-1277-4b7e-acbc-3a3dc36cae3f tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] HTTP exception thrown: Instance 2d623582-8352-4294-9aca-086539f32232 is not attached to volume 8ea7b375-edd3-45d2-aacb-aada52e44d43 Oct 28 09:53:55.574342 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-91107124-1277-4b7e-acbc-3a3dc36cae3f tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Returning 404 to user: Instance 2d623582-8352-4294-9aca-086539f32232 is not attached to volume 8ea7b375-edd3-45d2-aacb-aada52e44d43 {{(pid=123068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:53:55.575172 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-91107124-1277-4b7e-acbc-3a3dc36cae3f tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "DELETE /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232/os-volume_attachments/8ea7b375-edd3-45d2-aacb-aada52e44d43" status: 404 len: 154 microversion: 2.1 time: 0.093103 Oct 28 09:53:55.575714 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 356/728] 10.222.0.104 () {58 vars in 1420 bytes} [Thu Oct 28 09:53:55 2021] DELETE /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232/os-volume_attachments/8ea7b375-edd3-45d2-aacb-aada52e44d43 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:53:56.123493 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-8b21353a-6c05-42aa-965c-077b4baa4d69 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:56.124351 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-8b21353a-6c05-42aa-965c-077b4baa4d69 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:56.130874 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8b21353a-6c05-42aa-965c-077b4baa4d69 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:56.131319 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8b21353a-6c05-42aa-965c-077b4baa4d69 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:56.132612 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8b21353a-6c05-42aa-965c-077b4baa4d69 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:56.133183 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8b21353a-6c05-42aa-965c-077b4baa4d69 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:56.209495 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-8b21353a-6c05-42aa-965c-077b4baa4d69 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action" status: 200 len: 23792 microversion: 2.1 time: 0.089541 Oct 28 09:53:56.210439 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 373/729] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:53:56 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action => generated 23792 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:53:56.405395 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-1c0f092a-118c-4ac9-b250-cc1681d7fa6e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:56.406243 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-1c0f092a-118c-4ac9-b250-cc1681d7fa6e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:56.413582 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1c0f092a-118c-4ac9-b250-cc1681d7fa6e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:56.414325 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1c0f092a-118c-4ac9-b250-cc1681d7fa6e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:56.415132 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1c0f092a-118c-4ac9-b250-cc1681d7fa6e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:56.415524 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1c0f092a-118c-4ac9-b250-cc1681d7fa6e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:56.483090 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-1c0f092a-118c-4ac9-b250-cc1681d7fa6e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 14 microversion: 2.20 time: 0.081270 Oct 28 09:53:56.483719 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 357/730] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:53:56 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:56.909507 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-cd914a78-426f-42bb-a19f-c5c1401c20d5 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:56.910084 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-cd914a78-426f-42bb-a19f-c5c1401c20d5 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:56.917472 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-cd914a78-426f-42bb-a19f-c5c1401c20d5 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:56.917906 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-cd914a78-426f-42bb-a19f-c5c1401c20d5 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:56.918653 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-cd914a78-426f-42bb-a19f-c5c1401c20d5 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:56.919073 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-cd914a78-426f-42bb-a19f-c5c1401c20d5 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:56.947294 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-cd914a78-426f-42bb-a19f-c5c1401c20d5 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Going to try to terminate instance {{(pid=123069) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 09:53:57.221988 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-8e785141-8b83-46d2-93d9-f23a44ff5927 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:57.222998 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-8e785141-8b83-46d2-93d9-f23a44ff5927 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:57.230029 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8e785141-8b83-46d2-93d9-f23a44ff5927 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:57.230467 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8e785141-8b83-46d2-93d9-f23a44ff5927 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:57.231232 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8e785141-8b83-46d2-93d9-f23a44ff5927 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:57.231654 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8e785141-8b83-46d2-93d9-f23a44ff5927 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:57.313473 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-8e785141-8b83-46d2-93d9-f23a44ff5927 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action" status: 200 len: 25457 microversion: 2.1 time: 0.095455 Oct 28 09:53:57.314116 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 358/731] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:53:57 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action => generated 25457 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 09:53:57.352894 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-cd914a78-426f-42bb-a19f-c5c1401c20d5 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "DELETE /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 204 len: 0 microversion: 2.1 time: 0.446884 Oct 28 09:53:57.353483 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 374/732] 10.222.0.104 () {58 vars in 1243 bytes} [Thu Oct 28 09:53:56 2021] DELETE /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:53:57.362131 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-cc33b5c0-9f53-4312-a9f7-993ced86d061 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:57.362803 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-cc33b5c0-9f53-4312-a9f7-993ced86d061 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:57.370941 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cc33b5c0-9f53-4312-a9f7-993ced86d061 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:57.371381 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cc33b5c0-9f53-4312-a9f7-993ced86d061 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:57.372152 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cc33b5c0-9f53-4312-a9f7-993ced86d061 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:57.372578 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cc33b5c0-9f53-4312-a9f7-993ced86d061 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:57.495079 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-3beb239e-bf63-4218-8575-aaa8fec6baac tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:57.496029 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-3beb239e-bf63-4218-8575-aaa8fec6baac tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:57.497941 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-cc33b5c0-9f53-4312-a9f7-993ced86d061 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:57.503190 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3beb239e-bf63-4218-8575-aaa8fec6baac tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:57.503631 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3beb239e-bf63-4218-8575-aaa8fec6baac tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:57.504669 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3beb239e-bf63-4218-8575-aaa8fec6baac tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:57.505108 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3beb239e-bf63-4218-8575-aaa8fec6baac tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:57.506168 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-cc33b5c0-9f53-4312-a9f7-993ced86d061 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1558 microversion: 2.1 time: 0.148002 Oct 28 09:53:57.506636 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 359/733] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:57 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:57.571755 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-3beb239e-bf63-4218-8575-aaa8fec6baac tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 14 microversion: 2.20 time: 0.081369 Oct 28 09:53:57.572397 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 375/734] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:53:57 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:53:58.325341 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-ffa4aff3-ce20-410e-b514-41b78edef378 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:58.326326 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-ffa4aff3-ce20-410e-b514-41b78edef378 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:58.332583 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ffa4aff3-ce20-410e-b514-41b78edef378 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:58.333051 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ffa4aff3-ce20-410e-b514-41b78edef378 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:58.333857 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ffa4aff3-ce20-410e-b514-41b78edef378 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:58.334282 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ffa4aff3-ce20-410e-b514-41b78edef378 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:58.417930 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-ffa4aff3-ce20-410e-b514-41b78edef378 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action" status: 200 len: 26499 microversion: 2.1 time: 0.096004 Oct 28 09:53:58.418480 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 360/735] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:53:58 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action => generated 26499 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:53:58.524621 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-51f5f8ca-9bcd-41a3-a4b9-78dd1c888b2d tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:58.525361 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-51f5f8ca-9bcd-41a3-a4b9-78dd1c888b2d tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:58.532099 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-51f5f8ca-9bcd-41a3-a4b9-78dd1c888b2d tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:58.532532 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-51f5f8ca-9bcd-41a3-a4b9-78dd1c888b2d tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:58.533310 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-51f5f8ca-9bcd-41a3-a4b9-78dd1c888b2d tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:58.533831 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-51f5f8ca-9bcd-41a3-a4b9-78dd1c888b2d tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:58.583086 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-a2daab3f-595e-4544-bfcc-492b89b01bb2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:58.589030 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-a2daab3f-595e-4544-bfcc-492b89b01bb2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:58.596231 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a2daab3f-595e-4544-bfcc-492b89b01bb2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:58.596701 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a2daab3f-595e-4544-bfcc-492b89b01bb2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:58.597490 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a2daab3f-595e-4544-bfcc-492b89b01bb2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:58.597923 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a2daab3f-595e-4544-bfcc-492b89b01bb2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:58.661738 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-a2daab3f-595e-4544-bfcc-492b89b01bb2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 14 microversion: 2.20 time: 0.082524 Oct 28 09:53:58.662711 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 361/736] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:53:58 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:53:58.663435 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-51f5f8ca-9bcd-41a3-a4b9-78dd1c888b2d tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:58.671111 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-51f5f8ca-9bcd-41a3-a4b9-78dd1c888b2d tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1558 microversion: 2.1 time: 0.151235 Oct 28 09:53:58.671607 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 376/737] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:58 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:59.429560 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-fa18c2ae-670a-4579-af8f-b42e52553c60 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:59.430559 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-fa18c2ae-670a-4579-af8f-b42e52553c60 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:59.437379 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fa18c2ae-670a-4579-af8f-b42e52553c60 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:59.437804 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fa18c2ae-670a-4579-af8f-b42e52553c60 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:59.438568 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fa18c2ae-670a-4579-af8f-b42e52553c60 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:59.439064 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fa18c2ae-670a-4579-af8f-b42e52553c60 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:59.525757 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-fa18c2ae-670a-4579-af8f-b42e52553c60 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action" status: 200 len: 27225 microversion: 2.1 time: 0.100645 Oct 28 09:53:59.526412 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 362/738] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:53:59 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action => generated 27225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:53:59.673472 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-9d357122-2bcc-4fcf-ae72-55ca4edd773f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:59.674436 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-9d357122-2bcc-4fcf-ae72-55ca4edd773f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:59.681627 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9d357122-2bcc-4fcf-ae72-55ca4edd773f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:59.682073 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9d357122-2bcc-4fcf-ae72-55ca4edd773f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:59.683008 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9d357122-2bcc-4fcf-ae72-55ca4edd773f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:59.683443 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9d357122-2bcc-4fcf-ae72-55ca4edd773f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:59.688357 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-3c3fc788-8d09-497c-8b64-079710f79199 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:59.689072 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-3c3fc788-8d09-497c-8b64-079710f79199 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:53:59.696450 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3c3fc788-8d09-497c-8b64-079710f79199 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:59.696932 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3c3fc788-8d09-497c-8b64-079710f79199 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:59.697707 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3c3fc788-8d09-497c-8b64-079710f79199 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:53:59.698135 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3c3fc788-8d09-497c-8b64-079710f79199 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:53:59.752151 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-9d357122-2bcc-4fcf-ae72-55ca4edd773f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 14 microversion: 2.20 time: 0.082199 Oct 28 09:53:59.755807 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 377/739] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:53:59 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:53:59.828772 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-3c3fc788-8d09-497c-8b64-079710f79199 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:59.836971 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-3c3fc788-8d09-497c-8b64-079710f79199 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1558 microversion: 2.1 time: 0.152662 Oct 28 09:53:59.837552 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 363/740] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:53:59 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:00.007370 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [req-82c19797-b727-4020-97dc-da339badc349 req-4b3d0a51-6ba4-4175-9512-2c3c7be47fcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d623582-8352-4294-9aca-086539f32232", "name": "network-vif-deleted", "tag": "cbe862a5-40a7-43ef-b2b3-73aad1487228"}]} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:00.009047 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:54:00.009047 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 09:54:00.017091 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-82c19797-b727-4020-97dc-da339badc349 req-4b3d0a51-6ba4-4175-9512-2c3c7be47fcb service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:00.017529 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-82c19797-b727-4020-97dc-da339badc349 req-4b3d0a51-6ba4-4175-9512-2c3c7be47fcb service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:00.029651 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.compute.server_external_events [req-82c19797-b727-4020-97dc-da339badc349 req-4b3d0a51-6ba4-4175-9512-2c3c7be47fcb service nova] Creating event network-vif-deleted:cbe862a5-40a7-43ef-b2b3-73aad1487228 for instance 2d623582-8352-4294-9aca-086539f32232 on hv-cinder-81571 Oct 28 09:54:00.035152 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [req-82c19797-b727-4020-97dc-da339badc349 req-4b3d0a51-6ba4-4175-9512-2c3c7be47fcb service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031713 Oct 28 09:54:00.035753 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 378/741] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:54:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:54:00.537687 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-d67b779a-83c1-46e7-9c99-0c7c4f88879d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:00.538849 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-d67b779a-83c1-46e7-9c99-0c7c4f88879d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:00.545202 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d67b779a-83c1-46e7-9c99-0c7c4f88879d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:00.545646 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d67b779a-83c1-46e7-9c99-0c7c4f88879d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:00.546429 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d67b779a-83c1-46e7-9c99-0c7c4f88879d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:00.546856 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d67b779a-83c1-46e7-9c99-0c7c4f88879d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:00.636457 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-d67b779a-83c1-46e7-9c99-0c7c4f88879d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action" status: 200 len: 27772 microversion: 2.1 time: 0.102383 Oct 28 09:54:00.637969 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 364/742] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:54:00 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action => generated 27772 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:54:00.765063 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-65149216-307b-4537-a234-dafdbf1737c0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:00.766166 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-65149216-307b-4537-a234-dafdbf1737c0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:00.772749 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-65149216-307b-4537-a234-dafdbf1737c0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:00.773208 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-65149216-307b-4537-a234-dafdbf1737c0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:00.773977 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-65149216-307b-4537-a234-dafdbf1737c0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:00.774411 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-65149216-307b-4537-a234-dafdbf1737c0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:00.839994 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-65149216-307b-4537-a234-dafdbf1737c0 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 14 microversion: 2.20 time: 0.079364 Oct 28 09:54:00.840778 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 379/743] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:54:00 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:00.854869 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-cb6c0c1f-9631-4ea7-a1e6-d48e1f5bcd5c tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:00.855548 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-cb6c0c1f-9631-4ea7-a1e6-d48e1f5bcd5c tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:00.862707 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cb6c0c1f-9631-4ea7-a1e6-d48e1f5bcd5c tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:00.863136 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cb6c0c1f-9631-4ea7-a1e6-d48e1f5bcd5c tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:00.863901 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cb6c0c1f-9631-4ea7-a1e6-d48e1f5bcd5c tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:00.864326 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cb6c0c1f-9631-4ea7-a1e6-d48e1f5bcd5c tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:00.895516 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cb6c0c1f-9631-4ea7-a1e6-d48e1f5bcd5c tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:00.895951 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cb6c0c1f-9631-4ea7-a1e6-d48e1f5bcd5c tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:00.896391 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.objects.instance [None req-cb6c0c1f-9631-4ea7-a1e6-d48e1f5bcd5c tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lazy-loading 'fault' on Instance uuid 2d623582-8352-4294-9aca-086539f32232 {{(pid=123068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 09:54:00.939407 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-cb6c0c1f-9631-4ea7-a1e6-d48e1f5bcd5c tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d043c131f1c41fdb9b1ee94558f914e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811afb17ee044ea7a3d2f22cd0a9d5e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:00.946397 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-cb6c0c1f-9631-4ea7-a1e6-d48e1f5bcd5c tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 200 len: 1352 microversion: 2.1 time: 0.096291 Oct 28 09:54:00.946969 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 365/744] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:54:00 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:54:01.649768 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-efac2f04-9b32-490f-abef-e430f9bb8b10 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:01.650791 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-efac2f04-9b32-490f-abef-e430f9bb8b10 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:01.657971 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-efac2f04-9b32-490f-abef-e430f9bb8b10 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:01.658415 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-efac2f04-9b32-490f-abef-e430f9bb8b10 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:01.659176 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-efac2f04-9b32-490f-abef-e430f9bb8b10 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:01.659603 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-efac2f04-9b32-490f-abef-e430f9bb8b10 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:01.739290 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-efac2f04-9b32-490f-abef-e430f9bb8b10 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action" status: 200 len: 28191 microversion: 2.1 time: 0.093984 Oct 28 09:54:01.739932 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 380/745] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:54:01 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action => generated 28191 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:54:01.850791 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-ee7f0095-4bac-4d43-b08d-4ef4b0456e9a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:01.851659 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-ee7f0095-4bac-4d43-b08d-4ef4b0456e9a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:01.858042 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ee7f0095-4bac-4d43-b08d-4ef4b0456e9a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:01.858674 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ee7f0095-4bac-4d43-b08d-4ef4b0456e9a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:01.859327 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ee7f0095-4bac-4d43-b08d-4ef4b0456e9a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:01.859762 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ee7f0095-4bac-4d43-b08d-4ef4b0456e9a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:01.927240 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-ee7f0095-4bac-4d43-b08d-4ef4b0456e9a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 14 microversion: 2.20 time: 0.080633 Oct 28 09:54:01.927882 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 366/746] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:54:01 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:01.972958 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-495c0027-910f-40ef-b7ae-b5c3e85a10d8 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:01.973660 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-495c0027-910f-40ef-b7ae-b5c3e85a10d8 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] [instance: 2d623582-8352-4294-9aca-086539f32232] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:01.980915 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-495c0027-910f-40ef-b7ae-b5c3e85a10d8 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:01.981370 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-495c0027-910f-40ef-b7ae-b5c3e85a10d8 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:01.982125 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-495c0027-910f-40ef-b7ae-b5c3e85a10d8 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:01.982536 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-495c0027-910f-40ef-b7ae-b5c3e85a10d8 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:01.996893 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.wsgi [None req-495c0027-910f-40ef-b7ae-b5c3e85a10d8 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] HTTP exception thrown: Instance 2d623582-8352-4294-9aca-086539f32232 could not be found. Oct 28 09:54:01.997512 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-495c0027-910f-40ef-b7ae-b5c3e85a10d8 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Returning 404 to user: Instance 2d623582-8352-4294-9aca-086539f32232 could not be found. {{(pid=123069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:54:01.998324 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-495c0027-910f-40ef-b7ae-b5c3e85a10d8 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232" status: 404 len: 111 microversion: 2.1 time: 0.029622 Oct 28 09:54:01.998856 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 381/747] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:54:01 2021] GET /compute/v2.1/servers/2d623582-8352-4294-9aca-086539f32232 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:54:02.008414 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-c488c0dd-bf7a-4532-8738-de0291491d11 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] Calling method '.version_select at 0x7fe121cac940>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:02.130282 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-c488c0dd-bf7a-4532-8738-de0291491d11 tempest-TestMinimumBasicScenario-1169862061 tempest-TestMinimumBasicScenario-1169862061-project] 10.222.0.104 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1910483775" status: 202 len: 0 microversion: 2.1 time: 0.126518 Oct 28 09:54:02.130788 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 367/748] 10.222.0.104 () {58 vars in 1276 bytes} [Thu Oct 28 09:54:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1910483775 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:54:02.751084 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-5f1ee453-0520-479e-8ffd-86c1df6b13bd tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:02.751980 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-5f1ee453-0520-479e-8ffd-86c1df6b13bd tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:02.758932 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5f1ee453-0520-479e-8ffd-86c1df6b13bd tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:02.759308 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5f1ee453-0520-479e-8ffd-86c1df6b13bd tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:02.760074 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5f1ee453-0520-479e-8ffd-86c1df6b13bd tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:02.760546 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5f1ee453-0520-479e-8ffd-86c1df6b13bd tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:02.829471 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-5f1ee453-0520-479e-8ffd-86c1df6b13bd tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action" status: 200 len: 28191 microversion: 2.1 time: 0.081951 Oct 28 09:54:02.834894 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 382/749] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:54:02 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action => generated 28191 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:54:02.938692 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-4d63ec2f-b7e8-4335-9130-96bbcd7d208e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:02.939715 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-4d63ec2f-b7e8-4335-9130-96bbcd7d208e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:02.946717 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4d63ec2f-b7e8-4335-9130-96bbcd7d208e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:02.947194 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4d63ec2f-b7e8-4335-9130-96bbcd7d208e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:02.947823 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4d63ec2f-b7e8-4335-9130-96bbcd7d208e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:02.948259 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4d63ec2f-b7e8-4335-9130-96bbcd7d208e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:03.012489 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-4d63ec2f-b7e8-4335-9130-96bbcd7d208e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 14 microversion: 2.20 time: 0.077780 Oct 28 09:54:03.013113 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 368/750] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:54:02 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:03.842124 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-d582777b-b374-4314-8054-5a0df5ee519a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:03.843504 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-d582777b-b374-4314-8054-5a0df5ee519a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:03.850785 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d582777b-b374-4314-8054-5a0df5ee519a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:03.851317 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d582777b-b374-4314-8054-5a0df5ee519a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:03.852102 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d582777b-b374-4314-8054-5a0df5ee519a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:03.852528 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d582777b-b374-4314-8054-5a0df5ee519a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:03.932554 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-d582777b-b374-4314-8054-5a0df5ee519a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action" status: 200 len: 28482 microversion: 2.1 time: 0.094275 Oct 28 09:54:03.934508 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 383/751] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:54:03 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action => generated 28482 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:54:04.023916 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-364da629-3db1-4683-998a-bc0653b40360 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:04.025267 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-364da629-3db1-4683-998a-bc0653b40360 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:04.032046 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-364da629-3db1-4683-998a-bc0653b40360 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:04.032760 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-364da629-3db1-4683-998a-bc0653b40360 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:04.033707 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-364da629-3db1-4683-998a-bc0653b40360 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:04.034131 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-364da629-3db1-4683-998a-bc0653b40360 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:04.106102 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-364da629-3db1-4683-998a-bc0653b40360 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 415 microversion: 2.20 time: 0.086127 Oct 28 09:54:04.106759 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 369/752] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:54:04 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 415 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:54:04.946367 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-d8e50222-483c-473b-8ccc-f5f7f4743f59 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:04.947764 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-d8e50222-483c-473b-8ccc-f5f7f4743f59 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:04.956856 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d8e50222-483c-473b-8ccc-f5f7f4743f59 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:04.957301 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d8e50222-483c-473b-8ccc-f5f7f4743f59 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:04.958084 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d8e50222-483c-473b-8ccc-f5f7f4743f59 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:04.958510 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d8e50222-483c-473b-8ccc-f5f7f4743f59 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:05.048980 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-d8e50222-483c-473b-8ccc-f5f7f4743f59 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action" status: 200 len: 28649 microversion: 2.1 time: 0.107923 Oct 28 09:54:05.049643 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 384/753] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:54:04 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action => generated 28649 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:54:05.119048 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-5e631611-1ce0-42d7-9a04-001a4b1ed667 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:05.120106 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-5e631611-1ce0-42d7-9a04-001a4b1ed667 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:05.127580 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5e631611-1ce0-42d7-9a04-001a4b1ed667 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:05.128032 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5e631611-1ce0-42d7-9a04-001a4b1ed667 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:05.129109 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5e631611-1ce0-42d7-9a04-001a4b1ed667 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:05.129542 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5e631611-1ce0-42d7-9a04-001a4b1ed667 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:05.202689 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-5e631611-1ce0-42d7-9a04-001a4b1ed667 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 12882 microversion: 2.20 time: 0.088587 Oct 28 09:54:05.203268 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 370/754] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:54:05 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 12882 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:54:06.066809 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-b3401dae-3e6c-43e7-8531-32277d18027b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:06.066809 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-b3401dae-3e6c-43e7-8531-32277d18027b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:06.070111 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b3401dae-3e6c-43e7-8531-32277d18027b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:06.071257 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b3401dae-3e6c-43e7-8531-32277d18027b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:06.072156 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b3401dae-3e6c-43e7-8531-32277d18027b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:06.072888 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b3401dae-3e6c-43e7-8531-32277d18027b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:06.145697 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-b3401dae-3e6c-43e7-8531-32277d18027b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action" status: 200 len: 28649 microversion: 2.1 time: 0.087375 Oct 28 09:54:06.146347 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 385/755] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:54:06 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action => generated 28649 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:54:06.215338 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-0e33228d-760f-40c3-be52-f44b6d7763eb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:06.216361 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-0e33228d-760f-40c3-be52-f44b6d7763eb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:06.223425 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0e33228d-760f-40c3-be52-f44b6d7763eb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:06.223870 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0e33228d-760f-40c3-be52-f44b6d7763eb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:06.224732 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0e33228d-760f-40c3-be52-f44b6d7763eb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:06.225134 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0e33228d-760f-40c3-be52-f44b6d7763eb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:06.300503 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-0e33228d-760f-40c3-be52-f44b6d7763eb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 18155 microversion: 2.20 time: 0.089560 Oct 28 09:54:06.304497 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 371/756] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:54:06 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 18155 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:54:07.158000 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-4eed0501-8fc7-4566-b5c0-f11df4bc2472 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:07.158991 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-4eed0501-8fc7-4566-b5c0-f11df4bc2472 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:07.167915 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4eed0501-8fc7-4566-b5c0-f11df4bc2472 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:07.168642 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4eed0501-8fc7-4566-b5c0-f11df4bc2472 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:07.169813 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4eed0501-8fc7-4566-b5c0-f11df4bc2472 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:07.170481 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4eed0501-8fc7-4566-b5c0-f11df4bc2472 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:07.248539 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-4eed0501-8fc7-4566-b5c0-f11df4bc2472 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action" status: 200 len: 28649 microversion: 2.1 time: 0.094363 Oct 28 09:54:07.249371 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 386/757] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:54:07 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action => generated 28649 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:54:07.313629 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-0aa71c27-64bd-4303-9973-335849816e47 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:07.314729 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-0aa71c27-64bd-4303-9973-335849816e47 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:07.322525 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0aa71c27-64bd-4303-9973-335849816e47 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:07.322966 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0aa71c27-64bd-4303-9973-335849816e47 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:07.323977 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0aa71c27-64bd-4303-9973-335849816e47 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:07.324395 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0aa71c27-64bd-4303-9973-335849816e47 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:07.418754 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-0aa71c27-64bd-4303-9973-335849816e47 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 18824 microversion: 2.20 time: 0.109324 Oct 28 09:54:07.419747 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 372/758] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:54:07 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 18824 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:54:08.261924 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-4a992b9b-f4c3-4b39-9a7a-23183ea7d13c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:08.263079 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-4a992b9b-f4c3-4b39-9a7a-23183ea7d13c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:08.271850 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4a992b9b-f4c3-4b39-9a7a-23183ea7d13c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:08.272507 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4a992b9b-f4c3-4b39-9a7a-23183ea7d13c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:08.273978 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4a992b9b-f4c3-4b39-9a7a-23183ea7d13c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:08.276603 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4a992b9b-f4c3-4b39-9a7a-23183ea7d13c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:08.346432 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-4a992b9b-f4c3-4b39-9a7a-23183ea7d13c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action" status: 200 len: 28649 microversion: 2.1 time: 0.088704 Oct 28 09:54:08.347163 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 387/759] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:54:08 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action => generated 28649 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:54:08.431624 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-41015498-89b1-4030-9eca-01fa43a0ae00 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:08.432770 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-41015498-89b1-4030-9eca-01fa43a0ae00 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:08.439681 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-41015498-89b1-4030-9eca-01fa43a0ae00 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:08.440214 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-41015498-89b1-4030-9eca-01fa43a0ae00 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:08.441043 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-41015498-89b1-4030-9eca-01fa43a0ae00 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:08.441452 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-41015498-89b1-4030-9eca-01fa43a0ae00 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:08.528565 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-41015498-89b1-4030-9eca-01fa43a0ae00 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 20997 microversion: 2.20 time: 0.101549 Oct 28 09:54:08.532360 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 373/760] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:54:08 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 20997 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:54:09.360309 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-e6cb30d7-2be7-4253-816f-cc53f6a4a584 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:09.361358 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-e6cb30d7-2be7-4253-816f-cc53f6a4a584 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:09.369388 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e6cb30d7-2be7-4253-816f-cc53f6a4a584 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:09.369825 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e6cb30d7-2be7-4253-816f-cc53f6a4a584 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:09.370606 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e6cb30d7-2be7-4253-816f-cc53f6a4a584 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:09.371123 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e6cb30d7-2be7-4253-816f-cc53f6a4a584 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:09.454827 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-e6cb30d7-2be7-4253-816f-cc53f6a4a584 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action" status: 200 len: 29894 microversion: 2.1 time: 0.096810 Oct 28 09:54:09.454827 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 388/761] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:54:09 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action => generated 29894 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:54:09.542602 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-d796b872-045d-4706-a0f4-eaf93f1cc7a6 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:09.549536 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-d796b872-045d-4706-a0f4-eaf93f1cc7a6 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:09.557818 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d796b872-045d-4706-a0f4-eaf93f1cc7a6 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:09.558271 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d796b872-045d-4706-a0f4-eaf93f1cc7a6 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:09.559071 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d796b872-045d-4706-a0f4-eaf93f1cc7a6 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:09.559508 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d796b872-045d-4706-a0f4-eaf93f1cc7a6 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:09.638254 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-d796b872-045d-4706-a0f4-eaf93f1cc7a6 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 22896 microversion: 2.20 time: 0.100954 Oct 28 09:54:09.639651 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 374/762] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:54:09 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 22896 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:54:10.467191 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-a61dcf42-70e0-46d9-826e-8811a311c069 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:10.467596 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-a61dcf42-70e0-46d9-826e-8811a311c069 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:10.474778 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a61dcf42-70e0-46d9-826e-8811a311c069 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:10.475231 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a61dcf42-70e0-46d9-826e-8811a311c069 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:10.476025 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a61dcf42-70e0-46d9-826e-8811a311c069 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:10.476463 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a61dcf42-70e0-46d9-826e-8811a311c069 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:10.561318 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-a61dcf42-70e0-46d9-826e-8811a311c069 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action" status: 200 len: 31780 microversion: 2.1 time: 0.098376 Oct 28 09:54:10.562040 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 389/763] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:54:10 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action => generated 31780 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:54:10.652625 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-40f0ebbc-bba2-4bfe-a8c8-e782222e622a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:10.654420 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-40f0ebbc-bba2-4bfe-a8c8-e782222e622a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:10.661920 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-40f0ebbc-bba2-4bfe-a8c8-e782222e622a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:10.672779 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-40f0ebbc-bba2-4bfe-a8c8-e782222e622a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:10.672779 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-40f0ebbc-bba2-4bfe-a8c8-e782222e622a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:10.672779 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-40f0ebbc-bba2-4bfe-a8c8-e782222e622a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:10.749336 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-40f0ebbc-bba2-4bfe-a8c8-e782222e622a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 24333 microversion: 2.20 time: 0.101458 Oct 28 09:54:10.750098 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 375/764] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:54:10 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 24333 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:54:11.573884 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-70c8f18a-7071-41c5-9966-d93c01b9c357 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:11.575091 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-70c8f18a-7071-41c5-9966-d93c01b9c357 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:11.582545 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-70c8f18a-7071-41c5-9966-d93c01b9c357 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:11.582996 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-70c8f18a-7071-41c5-9966-d93c01b9c357 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:11.583786 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-70c8f18a-7071-41c5-9966-d93c01b9c357 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:11.584209 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-70c8f18a-7071-41c5-9966-d93c01b9c357 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:11.666793 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-70c8f18a-7071-41c5-9966-d93c01b9c357 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action" status: 200 len: 33082 microversion: 2.1 time: 0.097111 Oct 28 09:54:11.667470 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 390/765] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:54:11 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action => generated 33082 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:54:11.762765 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-4cdda7c3-ab07-4271-951c-467b4ecf91a3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:11.763705 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-4cdda7c3-ab07-4271-951c-467b4ecf91a3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:11.770867 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4cdda7c3-ab07-4271-951c-467b4ecf91a3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:11.771319 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4cdda7c3-ab07-4271-951c-467b4ecf91a3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:11.772092 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4cdda7c3-ab07-4271-951c-467b4ecf91a3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:11.772522 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4cdda7c3-ab07-4271-951c-467b4ecf91a3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:11.856855 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-4cdda7c3-ab07-4271-951c-467b4ecf91a3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 25692 microversion: 2.20 time: 0.098217 Oct 28 09:54:11.860759 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 376/766] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:54:11 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 25692 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:54:12.681229 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-3d998d12-e60c-4d10-b746-c7b9feabb9ba tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:12.682245 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-3d998d12-e60c-4d10-b746-c7b9feabb9ba tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:12.691321 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3d998d12-e60c-4d10-b746-c7b9feabb9ba tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:12.692211 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3d998d12-e60c-4d10-b746-c7b9feabb9ba tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:12.693292 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3d998d12-e60c-4d10-b746-c7b9feabb9ba tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:12.694635 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3d998d12-e60c-4d10-b746-c7b9feabb9ba tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:12.779961 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-3d998d12-e60c-4d10-b746-c7b9feabb9ba tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action" status: 200 len: 33777 microversion: 2.1 time: 0.104048 Oct 28 09:54:12.780609 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 391/767] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:54:12 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action => generated 33777 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:54:12.869841 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-6e3cab11-8dcf-4d06-979b-2a6054afad1f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:12.870827 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-6e3cab11-8dcf-4d06-979b-2a6054afad1f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:12.877761 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6e3cab11-8dcf-4d06-979b-2a6054afad1f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:12.878456 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6e3cab11-8dcf-4d06-979b-2a6054afad1f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:12.879390 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6e3cab11-8dcf-4d06-979b-2a6054afad1f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:12.879819 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6e3cab11-8dcf-4d06-979b-2a6054afad1f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:12.963747 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-6e3cab11-8dcf-4d06-979b-2a6054afad1f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 26746 microversion: 2.20 time: 0.098535 Oct 28 09:54:12.964688 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 377/768] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:54:12 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 26746 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:54:13.792330 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-d69cb7b8-0885-4b5c-bbcb-b8f9f46739e4 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:13.793361 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-d69cb7b8-0885-4b5c-bbcb-b8f9f46739e4 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:13.800230 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d69cb7b8-0885-4b5c-bbcb-b8f9f46739e4 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:13.800694 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d69cb7b8-0885-4b5c-bbcb-b8f9f46739e4 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:13.801464 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d69cb7b8-0885-4b5c-bbcb-b8f9f46739e4 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:13.801900 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d69cb7b8-0885-4b5c-bbcb-b8f9f46739e4 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:13.881511 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-d69cb7b8-0885-4b5c-bbcb-b8f9f46739e4 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action" status: 200 len: 34845 microversion: 2.1 time: 0.093495 Oct 28 09:54:13.882159 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 392/769] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:54:13 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action => generated 34845 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:54:13.975849 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-18c72ad2-92ff-455e-8ab3-cdc16e547806 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:13.976774 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-18c72ad2-92ff-455e-8ab3-cdc16e547806 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:13.984176 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-18c72ad2-92ff-455e-8ab3-cdc16e547806 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:13.984616 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-18c72ad2-92ff-455e-8ab3-cdc16e547806 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:13.985419 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-18c72ad2-92ff-455e-8ab3-cdc16e547806 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:13.985842 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-18c72ad2-92ff-455e-8ab3-cdc16e547806 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:14.064785 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-18c72ad2-92ff-455e-8ab3-cdc16e547806 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 27536 microversion: 2.20 time: 0.092847 Oct 28 09:54:14.065638 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 378/770] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:54:13 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 27536 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:54:14.893823 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-2d9aeb61-d460-4961-930a-554758169c95 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:14.894733 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-2d9aeb61-d460-4961-930a-554758169c95 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:14.901837 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2d9aeb61-d460-4961-930a-554758169c95 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:14.902273 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2d9aeb61-d460-4961-930a-554758169c95 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:14.903031 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2d9aeb61-d460-4961-930a-554758169c95 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:14.903453 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2d9aeb61-d460-4961-930a-554758169c95 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:14.995197 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-2d9aeb61-d460-4961-930a-554758169c95 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action" status: 200 len: 35871 microversion: 2.1 time: 0.105201 Oct 28 09:54:14.995875 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 393/771] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:54:14 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action => generated 35871 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:54:15.083648 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-25746abe-27e6-4661-946b-fd7589eb3524 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:15.084699 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-25746abe-27e6-4661-946b-fd7589eb3524 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:15.091877 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-25746abe-27e6-4661-946b-fd7589eb3524 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:15.092316 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-25746abe-27e6-4661-946b-fd7589eb3524 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:15.093112 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-25746abe-27e6-4661-946b-fd7589eb3524 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:15.093542 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-25746abe-27e6-4661-946b-fd7589eb3524 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:15.174998 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-25746abe-27e6-4661-946b-fd7589eb3524 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 27915 microversion: 2.20 time: 0.095435 Oct 28 09:54:15.175674 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 379/772] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:54:15 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 27915 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 09:54:16.009100 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-6d32e517-5bf1-419c-8f73-4b67a9f40515 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:16.010111 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-6d32e517-5bf1-419c-8f73-4b67a9f40515 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:16.017074 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6d32e517-5bf1-419c-8f73-4b67a9f40515 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:16.017516 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6d32e517-5bf1-419c-8f73-4b67a9f40515 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:16.018289 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6d32e517-5bf1-419c-8f73-4b67a9f40515 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:16.018719 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6d32e517-5bf1-419c-8f73-4b67a9f40515 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:16.101716 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-6d32e517-5bf1-419c-8f73-4b67a9f40515 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action" status: 200 len: 37263 microversion: 2.1 time: 0.097402 Oct 28 09:54:16.102588 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 394/773] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:54:16 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action => generated 37263 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:54:16.187054 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-f749d393-a4bb-4508-9ce7-a585533d8140 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:16.188062 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-f749d393-a4bb-4508-9ce7-a585533d8140 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:16.195009 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f749d393-a4bb-4508-9ce7-a585533d8140 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:16.195454 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f749d393-a4bb-4508-9ce7-a585533d8140 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:16.196812 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f749d393-a4bb-4508-9ce7-a585533d8140 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:16.197247 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f749d393-a4bb-4508-9ce7-a585533d8140 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:16.284995 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-f749d393-a4bb-4508-9ce7-a585533d8140 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 28210 microversion: 2.20 time: 0.101732 Oct 28 09:54:16.285558 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 380/774] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:54:16 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 28210 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 09:54:17.114703 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-f8ae12a7-f4d1-4126-89b7-db23bc269cd7 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:17.115708 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-f8ae12a7-f4d1-4126-89b7-db23bc269cd7 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:17.123647 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f8ae12a7-f4d1-4126-89b7-db23bc269cd7 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:17.124098 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f8ae12a7-f4d1-4126-89b7-db23bc269cd7 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:17.124925 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f8ae12a7-f4d1-4126-89b7-db23bc269cd7 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:17.125356 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f8ae12a7-f4d1-4126-89b7-db23bc269cd7 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:17.203204 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-f8ae12a7-f4d1-4126-89b7-db23bc269cd7 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action" status: 200 len: 38178 microversion: 2.1 time: 0.092492 Oct 28 09:54:17.204780 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 395/775] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:54:17 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action => generated 38178 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:54:17.297323 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-37bb0b91-ab04-40db-84e0-4bf520d50f4d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:17.298322 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-37bb0b91-ab04-40db-84e0-4bf520d50f4d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:17.307155 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-37bb0b91-ab04-40db-84e0-4bf520d50f4d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:17.307644 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-37bb0b91-ab04-40db-84e0-4bf520d50f4d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:17.308417 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-37bb0b91-ab04-40db-84e0-4bf520d50f4d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:17.308880 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-37bb0b91-ab04-40db-84e0-4bf520d50f4d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:17.393845 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-37bb0b91-ab04-40db-84e0-4bf520d50f4d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 28242 microversion: 2.20 time: 0.100336 Oct 28 09:54:17.394547 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 381/776] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:54:17 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 28242 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 09:54:18.216210 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-21b87963-ce8e-482f-b39a-5ed4c4668ea9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:18.217388 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-21b87963-ce8e-482f-b39a-5ed4c4668ea9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:18.224841 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-21b87963-ce8e-482f-b39a-5ed4c4668ea9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:18.225286 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-21b87963-ce8e-482f-b39a-5ed4c4668ea9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:18.226052 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-21b87963-ce8e-482f-b39a-5ed4c4668ea9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:18.226481 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-21b87963-ce8e-482f-b39a-5ed4c4668ea9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:18.294704 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-21b87963-ce8e-482f-b39a-5ed4c4668ea9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action" status: 200 len: 38178 microversion: 2.1 time: 0.082939 Oct 28 09:54:18.295353 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 396/777] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:54:18 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action => generated 38178 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:54:18.406633 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-dd945688-68a2-42d7-a0f9-d9d856080a9e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:18.407674 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-dd945688-68a2-42d7-a0f9-d9d856080a9e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:18.414566 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-dd945688-68a2-42d7-a0f9-d9d856080a9e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:18.415007 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-dd945688-68a2-42d7-a0f9-d9d856080a9e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:18.415778 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-dd945688-68a2-42d7-a0f9-d9d856080a9e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:18.416209 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-dd945688-68a2-42d7-a0f9-d9d856080a9e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:18.495030 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-dd945688-68a2-42d7-a0f9-d9d856080a9e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 28500 microversion: 2.20 time: 0.092656 Oct 28 09:54:18.496122 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 382/778] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:54:18 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 28500 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:54:19.307249 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-a4e7bc82-cbbb-4f17-998d-edb33e7257cb tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:19.308453 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-a4e7bc82-cbbb-4f17-998d-edb33e7257cb tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:19.316202 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a4e7bc82-cbbb-4f17-998d-edb33e7257cb tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:19.316758 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a4e7bc82-cbbb-4f17-998d-edb33e7257cb tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:19.317621 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a4e7bc82-cbbb-4f17-998d-edb33e7257cb tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:19.318059 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a4e7bc82-cbbb-4f17-998d-edb33e7257cb tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:19.389779 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-a4e7bc82-cbbb-4f17-998d-edb33e7257cb tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action" status: 200 len: 38178 microversion: 2.1 time: 0.086403 Oct 28 09:54:19.390434 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 397/779] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:54:19 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action => generated 38178 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:54:19.508023 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-5b3aba0a-f866-47f2-8181-fefd2e0c9c1c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:19.509173 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-5b3aba0a-f866-47f2-8181-fefd2e0c9c1c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:19.517973 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5b3aba0a-f866-47f2-8181-fefd2e0c9c1c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:19.518414 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5b3aba0a-f866-47f2-8181-fefd2e0c9c1c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:19.519292 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5b3aba0a-f866-47f2-8181-fefd2e0c9c1c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:19.519713 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5b3aba0a-f866-47f2-8181-fefd2e0c9c1c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:19.598469 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-5b3aba0a-f866-47f2-8181-fefd2e0c9c1c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 28668 microversion: 2.20 time: 0.094247 Oct 28 09:54:19.599070 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 383/780] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:54:19 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 28668 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:54:20.402033 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-6d0769a4-6b71-4508-b470-9f3854c3e1e8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:20.403781 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-6d0769a4-6b71-4508-b470-9f3854c3e1e8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:20.410838 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6d0769a4-6b71-4508-b470-9f3854c3e1e8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:20.411293 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6d0769a4-6b71-4508-b470-9f3854c3e1e8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:20.412080 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6d0769a4-6b71-4508-b470-9f3854c3e1e8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:20.412509 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6d0769a4-6b71-4508-b470-9f3854c3e1e8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:20.506858 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-6d0769a4-6b71-4508-b470-9f3854c3e1e8 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action" status: 200 len: 38198 microversion: 2.1 time: 0.108670 Oct 28 09:54:20.507647 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 398/781] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:54:20 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action => generated 38198 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:54:20.611493 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-9c205c17-9b41-47cf-9f30-74a97b7def7c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:20.612695 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-9c205c17-9b41-47cf-9f30-74a97b7def7c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:20.619782 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9c205c17-9b41-47cf-9f30-74a97b7def7c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:20.620228 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9c205c17-9b41-47cf-9f30-74a97b7def7c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:20.621048 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9c205c17-9b41-47cf-9f30-74a97b7def7c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:20.621624 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9c205c17-9b41-47cf-9f30-74a97b7def7c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:20.688581 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-9c205c17-9b41-47cf-9f30-74a97b7def7c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 28668 microversion: 2.20 time: 0.081056 Oct 28 09:54:20.689266 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 384/782] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:54:20 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 28668 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:54:21.519915 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-19084ca8-9776-436b-8fd9-82347b2a6d65 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:21.520942 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-19084ca8-9776-436b-8fd9-82347b2a6d65 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:21.528533 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-19084ca8-9776-436b-8fd9-82347b2a6d65 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:21.529042 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-19084ca8-9776-436b-8fd9-82347b2a6d65 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:21.529770 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-19084ca8-9776-436b-8fd9-82347b2a6d65 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:21.530193 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-19084ca8-9776-436b-8fd9-82347b2a6d65 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:21.613092 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-19084ca8-9776-436b-8fd9-82347b2a6d65 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action" status: 200 len: 38306 microversion: 2.1 time: 0.096609 Oct 28 09:54:21.614069 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 399/783] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:54:21 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/action => generated 38306 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:54:21.625348 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-caddef54-83cd-49a7-a4a4-32d34cae9d85 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:21.625932 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-caddef54-83cd-49a7-a4a4-32d34cae9d85 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:21.633163 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-caddef54-83cd-49a7-a4a4-32d34cae9d85 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:21.633606 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-caddef54-83cd-49a7-a4a4-32d34cae9d85 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:21.634384 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-caddef54-83cd-49a7-a4a4-32d34cae9d85 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:21.634807 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-caddef54-83cd-49a7-a4a4-32d34cae9d85 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:21.661521 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-caddef54-83cd-49a7-a4a4-32d34cae9d85 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/ips" status: 200 len: 145 microversion: 2.1 time: 0.040607 Oct 28 09:54:21.662267 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 385/784] 10.222.0.104 () {58 vars in 1252 bytes} [Thu Oct 28 09:54:21 2021] GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:54:21.707295 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-64e51429-ea18-4393-821f-c45e0b301b32 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:21.708285 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-64e51429-ea18-4393-821f-c45e0b301b32 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:21.715171 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-64e51429-ea18-4393-821f-c45e0b301b32 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:21.716207 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-64e51429-ea18-4393-821f-c45e0b301b32 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:21.717001 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-64e51429-ea18-4393-821f-c45e0b301b32 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:21.717419 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-64e51429-ea18-4393-821f-c45e0b301b32 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:21.788496 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-64e51429-ea18-4393-821f-c45e0b301b32 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 28668 microversion: 2.20 time: 0.084882 Oct 28 09:54:21.789927 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 400/785] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:54:21 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 28668 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:54:22.805963 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-5c7f1593-34b0-4fde-a938-f25c9b019d0a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:22.806926 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-5c7f1593-34b0-4fde-a938-f25c9b019d0a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:22.813792 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5c7f1593-34b0-4fde-a938-f25c9b019d0a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:22.814265 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5c7f1593-34b0-4fde-a938-f25c9b019d0a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:22.815036 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5c7f1593-34b0-4fde-a938-f25c9b019d0a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:22.815466 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5c7f1593-34b0-4fde-a938-f25c9b019d0a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:22.894214 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-5c7f1593-34b0-4fde-a938-f25c9b019d0a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 28919 microversion: 2.20 time: 0.091769 Oct 28 09:54:22.894977 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 386/786] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:54:22 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 28919 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:54:23.299087 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-23e2430b-61bf-4a5b-a203-be273dc60e68 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "580df755-31e7-42c4-b61d-b223257f82fc"}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:23.300229 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-23e2430b-61bf-4a5b-a203-be273dc60e68 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:23.307082 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-23e2430b-61bf-4a5b-a203-be273dc60e68 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:23.307520 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-23e2430b-61bf-4a5b-a203-be273dc60e68 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:23.308287 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-23e2430b-61bf-4a5b-a203-be273dc60e68 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:23.308735 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-23e2430b-61bf-4a5b-a203-be273dc60e68 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:23.906512 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-0161e608-ff6d-4501-b326-cef4bd852281 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:23.907507 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-0161e608-ff6d-4501-b326-cef4bd852281 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:23.914370 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0161e608-ff6d-4501-b326-cef4bd852281 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:23.914852 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0161e608-ff6d-4501-b326-cef4bd852281 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:23.915616 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0161e608-ff6d-4501-b326-cef4bd852281 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:23.916044 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0161e608-ff6d-4501-b326-cef4bd852281 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:24.001512 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-0161e608-ff6d-4501-b326-cef4bd852281 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 31032 microversion: 2.20 time: 0.098974 Oct 28 09:54:24.002183 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 387/787] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:54:23 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 31032 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 09:54:24.029367 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-23e2430b-61bf-4a5b-a203-be273dc60e68 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.734241 Oct 28 09:54:24.029966 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 401/788] 10.222.0.104 () {60 vars in 1327 bytes} [Thu Oct 28 09:54:23 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/os-volume_attachments => generated 194 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:54:25.015120 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-5cddddd0-4716-42a1-ab51-d5a29cbea2b1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:25.016149 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-5cddddd0-4716-42a1-ab51-d5a29cbea2b1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:25.023155 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5cddddd0-4716-42a1-ab51-d5a29cbea2b1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:25.023678 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5cddddd0-4716-42a1-ab51-d5a29cbea2b1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:25.024461 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5cddddd0-4716-42a1-ab51-d5a29cbea2b1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:25.024917 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5cddddd0-4716-42a1-ab51-d5a29cbea2b1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:25.097360 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-5cddddd0-4716-42a1-ab51-d5a29cbea2b1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 32812 microversion: 2.20 time: 0.086661 Oct 28 09:54:25.101891 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 388/789] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:54:25 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 32812 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:54:26.111078 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-f537c736-62a8-490e-8a7c-793d4c815cc9 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:26.112082 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-f537c736-62a8-490e-8a7c-793d4c815cc9 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:26.118376 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f537c736-62a8-490e-8a7c-793d4c815cc9 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:26.118858 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f537c736-62a8-490e-8a7c-793d4c815cc9 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:26.119643 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f537c736-62a8-490e-8a7c-793d4c815cc9 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:26.120065 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f537c736-62a8-490e-8a7c-793d4c815cc9 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:26.193394 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-f537c736-62a8-490e-8a7c-793d4c815cc9 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 33759 microversion: 2.20 time: 0.086592 Oct 28 09:54:26.194121 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 402/790] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:54:26 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 33759 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:54:27.205508 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-7a3c0dcb-0b88-4d9b-943b-2cb4bdf7024b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:27.206616 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-7a3c0dcb-0b88-4d9b-943b-2cb4bdf7024b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:27.213663 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7a3c0dcb-0b88-4d9b-943b-2cb4bdf7024b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:27.214320 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7a3c0dcb-0b88-4d9b-943b-2cb4bdf7024b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:27.215145 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7a3c0dcb-0b88-4d9b-943b-2cb4bdf7024b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:27.215581 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7a3c0dcb-0b88-4d9b-943b-2cb4bdf7024b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:27.297484 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-7a3c0dcb-0b88-4d9b-943b-2cb4bdf7024b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 34969 microversion: 2.20 time: 0.095804 Oct 28 09:54:27.298351 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 389/791] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:54:27 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 34969 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:54:28.309908 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-e48dbda2-70e7-476b-bfc0-547a42eca3b1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:28.311656 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-e48dbda2-70e7-476b-bfc0-547a42eca3b1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:28.319218 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e48dbda2-70e7-476b-bfc0-547a42eca3b1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:28.319657 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e48dbda2-70e7-476b-bfc0-547a42eca3b1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:28.320426 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e48dbda2-70e7-476b-bfc0-547a42eca3b1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:28.320893 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e48dbda2-70e7-476b-bfc0-547a42eca3b1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:28.396848 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-e48dbda2-70e7-476b-bfc0-547a42eca3b1 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 36255 microversion: 2.20 time: 0.090661 Oct 28 09:54:28.397670 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 403/792] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:54:28 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 36255 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:54:29.409642 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-bc630283-04eb-4a0b-ad4c-147e5c8feff2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:29.410666 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-bc630283-04eb-4a0b-ad4c-147e5c8feff2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:29.417864 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bc630283-04eb-4a0b-ad4c-147e5c8feff2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:29.418312 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bc630283-04eb-4a0b-ad4c-147e5c8feff2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:29.419088 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bc630283-04eb-4a0b-ad4c-147e5c8feff2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:29.419523 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bc630283-04eb-4a0b-ad4c-147e5c8feff2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:29.495216 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-bc630283-04eb-4a0b-ad4c-147e5c8feff2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 37880 microversion: 2.20 time: 0.089933 Oct 28 09:54:29.495872 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 390/793] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:54:29 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 37880 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:54:30.508251 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-1ad0054c-092f-44c1-88d4-a3b61be94440 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:30.509310 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-1ad0054c-092f-44c1-88d4-a3b61be94440 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:30.517009 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1ad0054c-092f-44c1-88d4-a3b61be94440 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:30.517445 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1ad0054c-092f-44c1-88d4-a3b61be94440 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:30.518218 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1ad0054c-092f-44c1-88d4-a3b61be94440 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:30.518670 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1ad0054c-092f-44c1-88d4-a3b61be94440 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:30.600159 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-1ad0054c-092f-44c1-88d4-a3b61be94440 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 38225 microversion: 2.20 time: 0.095741 Oct 28 09:54:30.601197 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 404/794] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:54:30 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 38225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:54:31.525784 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-b0c5cfc0-3a41-48d6-b71b-cb7a0b04a28d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:31.526786 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-b0c5cfc0-3a41-48d6-b71b-cb7a0b04a28d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:31.533863 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b0c5cfc0-3a41-48d6-b71b-cb7a0b04a28d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:31.534303 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b0c5cfc0-3a41-48d6-b71b-cb7a0b04a28d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:31.535071 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b0c5cfc0-3a41-48d6-b71b-cb7a0b04a28d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:31.535496 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b0c5cfc0-3a41-48d6-b71b-cb7a0b04a28d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:31.566911 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-b0c5cfc0-3a41-48d6-b71b-cb7a0b04a28d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045130 Oct 28 09:54:31.567489 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 391/795] 10.222.0.104 () {58 vars in 1306 bytes} [Thu Oct 28 09:54:31 2021] GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:54:31.577720 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-09c38335-e057-4709-8d82-e3d8eaf99ded tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:31.578296 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-09c38335-e057-4709-8d82-e3d8eaf99ded tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:31.585071 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-09c38335-e057-4709-8d82-e3d8eaf99ded tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:31.585510 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-09c38335-e057-4709-8d82-e3d8eaf99ded tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:31.586294 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-09c38335-e057-4709-8d82-e3d8eaf99ded tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:31.586717 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-09c38335-e057-4709-8d82-e3d8eaf99ded tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:31.611838 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-d7e7b364-03c9-4983-8608-84ccb46c61b2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:31.613412 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-d7e7b364-03c9-4983-8608-84ccb46c61b2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:31.617634 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-09c38335-e057-4709-8d82-e3d8eaf99ded tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/os-volume_attachments/580df755-31e7-42c4-b61d-b223257f82fc" status: 200 len: 194 microversion: 2.1 time: 0.044025 Oct 28 09:54:31.618242 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 405/796] 10.222.0.104 () {58 vars in 1417 bytes} [Thu Oct 28 09:54:31 2021] GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/os-volume_attachments/580df755-31e7-42c4-b61d-b223257f82fc => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:54:31.619698 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d7e7b364-03c9-4983-8608-84ccb46c61b2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:31.620134 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d7e7b364-03c9-4983-8608-84ccb46c61b2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:31.620930 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d7e7b364-03c9-4983-8608-84ccb46c61b2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:31.621359 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d7e7b364-03c9-4983-8608-84ccb46c61b2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:31.681405 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-d7e7b364-03c9-4983-8608-84ccb46c61b2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 38225 microversion: 2.20 time: 0.073550 Oct 28 09:54:31.682326 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 392/797] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:54:31 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 38225 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 09:54:32.693765 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-51afba22-a8d7-45b7-a05f-a3421442578e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:32.694644 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-51afba22-a8d7-45b7-a05f-a3421442578e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:32.701157 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-51afba22-a8d7-45b7-a05f-a3421442578e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:32.702205 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-51afba22-a8d7-45b7-a05f-a3421442578e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:32.703283 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-51afba22-a8d7-45b7-a05f-a3421442578e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:32.703706 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-51afba22-a8d7-45b7-a05f-a3421442578e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:32.764099 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-51afba22-a8d7-45b7-a05f-a3421442578e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 38225 microversion: 2.20 time: 0.073632 Oct 28 09:54:32.764511 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 406/798] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:54:32 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 38225 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 09:54:33.293842 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-4f678956-3227-4af9-ab35-6f6f382a634c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e609d58c-714a-43aa-8d34-f6ba2df0392f"}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:33.295071 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-4f678956-3227-4af9-ab35-6f6f382a634c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:33.302730 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4f678956-3227-4af9-ab35-6f6f382a634c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:33.303163 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4f678956-3227-4af9-ab35-6f6f382a634c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:33.303957 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4f678956-3227-4af9-ab35-6f6f382a634c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:33.304382 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4f678956-3227-4af9-ab35-6f6f382a634c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:33.776250 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-7c0d1f81-4a06-4ecb-aa48-15b24f2a88b2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:33.777284 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-7c0d1f81-4a06-4ecb-aa48-15b24f2a88b2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:33.784909 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7c0d1f81-4a06-4ecb-aa48-15b24f2a88b2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:33.785354 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7c0d1f81-4a06-4ecb-aa48-15b24f2a88b2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:33.786126 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7c0d1f81-4a06-4ecb-aa48-15b24f2a88b2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:33.786556 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7c0d1f81-4a06-4ecb-aa48-15b24f2a88b2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:33.862432 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-7c0d1f81-4a06-4ecb-aa48-15b24f2a88b2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 38278 microversion: 2.20 time: 0.089739 Oct 28 09:54:33.863454 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 407/799] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:54:33 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 38278 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 28 09:54:34.090894 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-4f678956-3227-4af9-ab35-6f6f382a634c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.800897 Oct 28 09:54:34.091498 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 393/800] 10.222.0.104 () {60 vars in 1327 bytes} [Thu Oct 28 09:54:33 2021] POST /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/os-volume_attachments => generated 194 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:54:34.876116 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-b5f44407-a288-4a2d-9a31-fb7afcf1f1b7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:34.877044 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-b5f44407-a288-4a2d-9a31-fb7afcf1f1b7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:34.884108 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b5f44407-a288-4a2d-9a31-fb7afcf1f1b7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:34.884544 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b5f44407-a288-4a2d-9a31-fb7afcf1f1b7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:34.885341 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b5f44407-a288-4a2d-9a31-fb7afcf1f1b7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:34.885770 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b5f44407-a288-4a2d-9a31-fb7afcf1f1b7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:34.959709 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-b5f44407-a288-4a2d-9a31-fb7afcf1f1b7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 200 len: 38368 microversion: 2.20 time: 0.088622 Oct 28 09:54:34.960362 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 408/801] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:54:34 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 38368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:54:34.971623 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-6714ef4f-1146-4a66-bbec-bc88fab1ba15 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:34.972217 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-6714ef4f-1146-4a66-bbec-bc88fab1ba15 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:34.978285 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6714ef4f-1146-4a66-bbec-bc88fab1ba15 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:34.978724 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6714ef4f-1146-4a66-bbec-bc88fab1ba15 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:34.979474 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6714ef4f-1146-4a66-bbec-bc88fab1ba15 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:34.979900 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6714ef4f-1146-4a66-bbec-bc88fab1ba15 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:35.004954 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-6714ef4f-1146-4a66-bbec-bc88fab1ba15 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/ips" status: 200 len: 152 microversion: 2.20 time: 0.038124 Oct 28 09:54:35.005525 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 394/802] 10.222.0.104 () {60 vars in 1293 bytes} [Thu Oct 28 09:54:34 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:54:35.859150 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-16af03f7-d984-4c84-af74-e284d60d84b7 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:35.859778 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-16af03f7-d984-4c84-af74-e284d60d84b7 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:35.867760 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-16af03f7-d984-4c84-af74-e284d60d84b7 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:35.868204 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-16af03f7-d984-4c84-af74-e284d60d84b7 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:35.869011 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-16af03f7-d984-4c84-af74-e284d60d84b7 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:35.869568 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-16af03f7-d984-4c84-af74-e284d60d84b7 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:35.894227 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.objects.instance [None req-16af03f7-d984-4c84-af74-e284d60d84b7 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lazy-loading 'flavor' on Instance uuid a28831e5-4c0c-4dd9-bf92-ccf43a500b27 {{(pid=123069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 09:54:36.152017 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-16af03f7-d984-4c84-af74-e284d60d84b7 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "POST /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27/action" status: 202 len: 0 microversion: 2.1 time: 0.297215 Oct 28 09:54:36.152515 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 409/803] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:54:35 2021] POST /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:54:36.161795 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-edecb4bd-8750-44d1-8313-111c05894635 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:36.162514 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-edecb4bd-8750-44d1-8313-111c05894635 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:36.168984 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-edecb4bd-8750-44d1-8313-111c05894635 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:36.169430 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-edecb4bd-8750-44d1-8313-111c05894635 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:36.170480 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-edecb4bd-8750-44d1-8313-111c05894635 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:36.171131 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-edecb4bd-8750-44d1-8313-111c05894635 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:36.298118 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-edecb4bd-8750-44d1-8313-111c05894635 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:36.305580 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-edecb4bd-8750-44d1-8313-111c05894635 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1572 microversion: 2.1 time: 0.148282 Oct 28 09:54:36.306784 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 395/804] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:54:36 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1572 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:37.324006 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-ee5c13cb-b2f9-45b4-a9df-84a6c7393e48 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:37.324719 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-ee5c13cb-b2f9-45b4-a9df-84a6c7393e48 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:37.331874 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ee5c13cb-b2f9-45b4-a9df-84a6c7393e48 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:37.332341 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ee5c13cb-b2f9-45b4-a9df-84a6c7393e48 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:37.333129 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ee5c13cb-b2f9-45b4-a9df-84a6c7393e48 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:37.333551 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ee5c13cb-b2f9-45b4-a9df-84a6c7393e48 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:37.344576 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-02564f3c-4977-4971-b915-8b719955df67 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:37.345144 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-02564f3c-4977-4971-b915-8b719955df67 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:37.351388 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-02564f3c-4977-4971-b915-8b719955df67 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:37.351840 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-02564f3c-4977-4971-b915-8b719955df67 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:37.352593 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-02564f3c-4977-4971-b915-8b719955df67 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:37.353065 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-02564f3c-4977-4971-b915-8b719955df67 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:37.381279 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.objects.instance [None req-02564f3c-4977-4971-b915-8b719955df67 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lazy-loading 'flavor' on Instance uuid 4f18b00b-bb81-40c2-96fc-aeb3627b6028 {{(pid=123068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 09:54:37.464338 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-ee5c13cb-b2f9-45b4-a9df-84a6c7393e48 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:37.471299 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-ee5c13cb-b2f9-45b4-a9df-84a6c7393e48 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1572 microversion: 2.1 time: 0.151702 Oct 28 09:54:37.471877 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 410/805] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:54:37 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1572 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:37.927423 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-02564f3c-4977-4971-b915-8b719955df67 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 202 len: 0 microversion: 2.20 time: 0.586059 Oct 28 09:54:37.928062 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 396/806] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:54:37 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 0 bytes in 588 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 28 09:54:37.937266 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-7b512774-2ee6-4d73-97c3-c8d64609594f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:37.937580 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-7b512774-2ee6-4d73-97c3-c8d64609594f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:37.944401 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7b512774-2ee6-4d73-97c3-c8d64609594f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:37.944881 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7b512774-2ee6-4d73-97c3-c8d64609594f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:37.945849 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7b512774-2ee6-4d73-97c3-c8d64609594f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:37.946272 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7b512774-2ee6-4d73-97c3-c8d64609594f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:38.081309 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-7b512774-2ee6-4d73-97c3-c8d64609594f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:38.089201 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-7b512774-2ee6-4d73-97c3-c8d64609594f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:38.090673 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-7b512774-2ee6-4d73-97c3-c8d64609594f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:38.092426 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-7b512774-2ee6-4d73-97c3-c8d64609594f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1728 microversion: 2.20 time: 0.159115 Oct 28 09:54:38.093045 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 411/807] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:54:37 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:54:38.490361 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-f54cc28e-9c5b-4f7c-ace9-edce4c7e850d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:38.491070 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-f54cc28e-9c5b-4f7c-ace9-edce4c7e850d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:38.497836 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f54cc28e-9c5b-4f7c-ace9-edce4c7e850d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:38.498468 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f54cc28e-9c5b-4f7c-ace9-edce4c7e850d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:38.499420 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f54cc28e-9c5b-4f7c-ace9-edce4c7e850d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:38.499855 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f54cc28e-9c5b-4f7c-ace9-edce4c7e850d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:38.627220 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-f54cc28e-9c5b-4f7c-ace9-edce4c7e850d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:38.634960 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-f54cc28e-9c5b-4f7c-ace9-edce4c7e850d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1572 microversion: 2.1 time: 0.149158 Oct 28 09:54:38.635518 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 397/808] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:54:38 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1572 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:39.111908 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-5167a3ac-aef4-4d87-aad6-a15324e9cb9d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:39.112811 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-5167a3ac-aef4-4d87-aad6-a15324e9cb9d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:39.119608 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5167a3ac-aef4-4d87-aad6-a15324e9cb9d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:39.122296 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5167a3ac-aef4-4d87-aad6-a15324e9cb9d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:39.122296 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5167a3ac-aef4-4d87-aad6-a15324e9cb9d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:39.122296 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5167a3ac-aef4-4d87-aad6-a15324e9cb9d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:39.250364 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-5167a3ac-aef4-4d87-aad6-a15324e9cb9d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:39.258340 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-5167a3ac-aef4-4d87-aad6-a15324e9cb9d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:39.259821 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-5167a3ac-aef4-4d87-aad6-a15324e9cb9d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:39.261000 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-5167a3ac-aef4-4d87-aad6-a15324e9cb9d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1728 microversion: 2.20 time: 0.154073 Oct 28 09:54:39.261556 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 412/809] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:54:39 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:54:39.652545 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-d5fd2440-6419-486a-bcfe-563837079acc tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:39.653239 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-d5fd2440-6419-486a-bcfe-563837079acc tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:39.660833 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d5fd2440-6419-486a-bcfe-563837079acc tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:39.661281 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d5fd2440-6419-486a-bcfe-563837079acc tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:39.662078 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d5fd2440-6419-486a-bcfe-563837079acc tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:39.662506 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d5fd2440-6419-486a-bcfe-563837079acc tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:39.798095 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-d5fd2440-6419-486a-bcfe-563837079acc tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:39.809825 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-d5fd2440-6419-486a-bcfe-563837079acc tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1572 microversion: 2.1 time: 0.160996 Oct 28 09:54:39.811410 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 398/810] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:54:39 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1572 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:40.280145 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-64436446-cc97-45cd-b07f-68c6902b5575 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:40.280944 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-64436446-cc97-45cd-b07f-68c6902b5575 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:40.287504 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-64436446-cc97-45cd-b07f-68c6902b5575 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:40.287944 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-64436446-cc97-45cd-b07f-68c6902b5575 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:40.288749 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-64436446-cc97-45cd-b07f-68c6902b5575 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:40.289179 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-64436446-cc97-45cd-b07f-68c6902b5575 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:40.421175 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-64436446-cc97-45cd-b07f-68c6902b5575 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:40.430301 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-64436446-cc97-45cd-b07f-68c6902b5575 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:40.431786 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-64436446-cc97-45cd-b07f-68c6902b5575 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:40.432981 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-64436446-cc97-45cd-b07f-68c6902b5575 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1728 microversion: 2.20 time: 0.157261 Oct 28 09:54:40.433543 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 413/811] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:54:40 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:54:40.828504 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-860e3acc-382d-4fbf-9444-d224f7805381 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:40.829365 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-860e3acc-382d-4fbf-9444-d224f7805381 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:40.838992 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-860e3acc-382d-4fbf-9444-d224f7805381 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:40.839596 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-860e3acc-382d-4fbf-9444-d224f7805381 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:40.840907 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-860e3acc-382d-4fbf-9444-d224f7805381 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:40.841418 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-860e3acc-382d-4fbf-9444-d224f7805381 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:40.981534 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-860e3acc-382d-4fbf-9444-d224f7805381 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:40.990149 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-860e3acc-382d-4fbf-9444-d224f7805381 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1572 microversion: 2.1 time: 0.166015 Oct 28 09:54:40.990721 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 399/812] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:54:40 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1572 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:41.454467 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-ad250a96-be96-43a8-9766-f0a507c66a80 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:41.455058 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-ad250a96-be96-43a8-9766-f0a507c66a80 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:41.461436 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ad250a96-be96-43a8-9766-f0a507c66a80 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:41.461877 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ad250a96-be96-43a8-9766-f0a507c66a80 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:41.462677 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ad250a96-be96-43a8-9766-f0a507c66a80 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:41.463107 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ad250a96-be96-43a8-9766-f0a507c66a80 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:41.597417 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-2805e463-5289-4e12-ac50-a72653a1ff54 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:41.600183 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-2805e463-5289-4e12-ac50-a72653a1ff54 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:41.604207 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2805e463-5289-4e12-ac50-a72653a1ff54 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:41.604642 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2805e463-5289-4e12-ac50-a72653a1ff54 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:41.605541 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2805e463-5289-4e12-ac50-a72653a1ff54 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:41.606516 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2805e463-5289-4e12-ac50-a72653a1ff54 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:41.610596 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-ad250a96-be96-43a8-9766-f0a507c66a80 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:41.618919 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-ad250a96-be96-43a8-9766-f0a507c66a80 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:41.620515 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-ad250a96-be96-43a8-9766-f0a507c66a80 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:41.621727 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-ad250a96-be96-43a8-9766-f0a507c66a80 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1728 microversion: 2.20 time: 0.171417 Oct 28 09:54:41.622279 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 414/813] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:54:41 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:54:41.640065 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-2805e463-5289-4e12-ac50-a72653a1ff54 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047173 Oct 28 09:54:41.640675 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 400/814] 10.222.0.104 () {58 vars in 1306 bytes} [Thu Oct 28 09:54:41 2021] GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:54:41.836578 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-affe6646-7e56-44f0-b9a8-72250b642eba tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:41.837007 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-affe6646-7e56-44f0-b9a8-72250b642eba tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:41.844638 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-affe6646-7e56-44f0-b9a8-72250b642eba tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:41.845205 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-affe6646-7e56-44f0-b9a8-72250b642eba tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:41.845986 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-affe6646-7e56-44f0-b9a8-72250b642eba tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:41.846328 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-affe6646-7e56-44f0-b9a8-72250b642eba tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:41.876445 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-affe6646-7e56-44f0-b9a8-72250b642eba tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/os-volume_attachments/580df755-31e7-42c4-b61d-b223257f82fc" status: 200 len: 194 microversion: 2.1 time: 0.043755 Oct 28 09:54:41.880839 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 415/815] 10.222.0.104 () {58 vars in 1417 bytes} [Thu Oct 28 09:54:41 2021] GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/os-volume_attachments/580df755-31e7-42c4-b61d-b223257f82fc => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:54:41.891656 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-70e171f3-5e9d-4202-86cb-67d1b1526cbf tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:41.892297 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-70e171f3-5e9d-4202-86cb-67d1b1526cbf tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:41.900534 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-70e171f3-5e9d-4202-86cb-67d1b1526cbf tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:41.901129 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-70e171f3-5e9d-4202-86cb-67d1b1526cbf tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:41.902136 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-70e171f3-5e9d-4202-86cb-67d1b1526cbf tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:41.903056 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-70e171f3-5e9d-4202-86cb-67d1b1526cbf tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:41.994317 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.objects.instance [None req-70e171f3-5e9d-4202-86cb-67d1b1526cbf tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lazy-loading 'services' on Instance uuid 914bc218-ac76-4448-82e3-f4059c8f8a8f {{(pid=123068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 09:54:42.007931 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-3509c1ab-a368-4e90-9b57-d6326cbf30bc tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:42.008642 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-3509c1ab-a368-4e90-9b57-d6326cbf30bc tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:42.017127 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3509c1ab-a368-4e90-9b57-d6326cbf30bc tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:42.017572 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3509c1ab-a368-4e90-9b57-d6326cbf30bc tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:42.018355 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3509c1ab-a368-4e90-9b57-d6326cbf30bc tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:42.018788 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3509c1ab-a368-4e90-9b57-d6326cbf30bc tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:42.158516 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-3509c1ab-a368-4e90-9b57-d6326cbf30bc tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:42.166210 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-3509c1ab-a368-4e90-9b57-d6326cbf30bc tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1572 microversion: 2.1 time: 0.162230 Oct 28 09:54:42.166791 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 416/816] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:54:42 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1572 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:54:42.259340 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-70e171f3-5e9d-4202-86cb-67d1b1526cbf tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "DELETE /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/os-volume_attachments/580df755-31e7-42c4-b61d-b223257f82fc" status: 202 len: 0 microversion: 2.1 time: 0.373465 Oct 28 09:54:42.259955 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 401/817] 10.222.0.104 () {58 vars in 1420 bytes} [Thu Oct 28 09:54:41 2021] DELETE /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/os-volume_attachments/580df755-31e7-42c4-b61d-b223257f82fc => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:54:42.643664 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-37ffc2ba-4857-4d75-bb85-852bd72d4b4f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:42.643664 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-37ffc2ba-4857-4d75-bb85-852bd72d4b4f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:42.647917 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-37ffc2ba-4857-4d75-bb85-852bd72d4b4f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:42.648351 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-37ffc2ba-4857-4d75-bb85-852bd72d4b4f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:42.649140 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-37ffc2ba-4857-4d75-bb85-852bd72d4b4f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:42.649566 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-37ffc2ba-4857-4d75-bb85-852bd72d4b4f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:42.785646 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-37ffc2ba-4857-4d75-bb85-852bd72d4b4f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:42.799736 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-37ffc2ba-4857-4d75-bb85-852bd72d4b4f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:42.802594 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-37ffc2ba-4857-4d75-bb85-852bd72d4b4f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:42.804786 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-37ffc2ba-4857-4d75-bb85-852bd72d4b4f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1728 microversion: 2.20 time: 0.167321 Oct 28 09:54:42.805792 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 417/818] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:54:42 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:54:43.184499 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-b392ad49-3a5c-43a4-b4d2-fb3712a21ec8 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:43.185310 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-b392ad49-3a5c-43a4-b4d2-fb3712a21ec8 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:43.193916 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b392ad49-3a5c-43a4-b4d2-fb3712a21ec8 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:43.194584 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b392ad49-3a5c-43a4-b4d2-fb3712a21ec8 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:43.195499 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b392ad49-3a5c-43a4-b4d2-fb3712a21ec8 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:43.196020 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b392ad49-3a5c-43a4-b4d2-fb3712a21ec8 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:43.332324 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-b392ad49-3a5c-43a4-b4d2-fb3712a21ec8 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:43.341046 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-b392ad49-3a5c-43a4-b4d2-fb3712a21ec8 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1572 microversion: 2.1 time: 0.160993 Oct 28 09:54:43.342236 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 402/819] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:54:43 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1572 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:43.832734 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-2d047559-591f-46b2-883e-bcba3ff2f98b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:43.833404 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-2d047559-591f-46b2-883e-bcba3ff2f98b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:43.839386 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2d047559-591f-46b2-883e-bcba3ff2f98b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:43.839815 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2d047559-591f-46b2-883e-bcba3ff2f98b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:43.840565 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2d047559-591f-46b2-883e-bcba3ff2f98b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:43.841010 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2d047559-591f-46b2-883e-bcba3ff2f98b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:43.965744 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-2d047559-591f-46b2-883e-bcba3ff2f98b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:43.974029 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-2d047559-591f-46b2-883e-bcba3ff2f98b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:43.975542 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-2d047559-591f-46b2-883e-bcba3ff2f98b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:43.976778 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-2d047559-591f-46b2-883e-bcba3ff2f98b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1728 microversion: 2.20 time: 0.147748 Oct 28 09:54:43.977339 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 418/820] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:54:43 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:54:44.360759 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-1c9055b7-5f58-434a-afe8-1f7315e67877 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:44.361418 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-1c9055b7-5f58-434a-afe8-1f7315e67877 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:44.367648 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1c9055b7-5f58-434a-afe8-1f7315e67877 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:44.368087 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1c9055b7-5f58-434a-afe8-1f7315e67877 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:44.368889 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1c9055b7-5f58-434a-afe8-1f7315e67877 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:44.369311 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1c9055b7-5f58-434a-afe8-1f7315e67877 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:44.442574 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-9d410acb-7aa8-45f5-8aad-63aab8fe6288 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:44.443167 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-9d410acb-7aa8-45f5-8aad-63aab8fe6288 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:44.449215 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9d410acb-7aa8-45f5-8aad-63aab8fe6288 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:44.449815 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9d410acb-7aa8-45f5-8aad-63aab8fe6288 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:44.450657 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9d410acb-7aa8-45f5-8aad-63aab8fe6288 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:44.451229 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9d410acb-7aa8-45f5-8aad-63aab8fe6288 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:44.487299 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-9d410acb-7aa8-45f5-8aad-63aab8fe6288 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/os-volume_attachments/e609d58c-714a-43aa-8d34-f6ba2df0392f" status: 200 len: 194 microversion: 2.1 time: 0.048555 Oct 28 09:54:44.487915 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 419/821] 10.222.0.104 () {58 vars in 1417 bytes} [Thu Oct 28 09:54:44 2021] GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/os-volume_attachments/e609d58c-714a-43aa-8d34-f6ba2df0392f => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:54:44.497330 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-33839646-7ee5-4404-9496-b46b9e0f0912 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:44.497330 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-33839646-7ee5-4404-9496-b46b9e0f0912 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:44.501169 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-1c9055b7-5f58-434a-afe8-1f7315e67877 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:44.504970 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-33839646-7ee5-4404-9496-b46b9e0f0912 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:44.505411 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-33839646-7ee5-4404-9496-b46b9e0f0912 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:44.506183 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-33839646-7ee5-4404-9496-b46b9e0f0912 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:44.506605 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-33839646-7ee5-4404-9496-b46b9e0f0912 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:44.509435 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-1c9055b7-5f58-434a-afe8-1f7315e67877 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1572 microversion: 2.1 time: 0.154026 Oct 28 09:54:44.511437 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 403/822] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:54:44 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1572 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:44.599153 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.objects.instance [None req-33839646-7ee5-4404-9496-b46b9e0f0912 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lazy-loading 'services' on Instance uuid 914bc218-ac76-4448-82e3-f4059c8f8a8f {{(pid=123069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 09:54:44.847068 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-33839646-7ee5-4404-9496-b46b9e0f0912 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "DELETE /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/os-volume_attachments/e609d58c-714a-43aa-8d34-f6ba2df0392f" status: 202 len: 0 microversion: 2.1 time: 0.353176 Oct 28 09:54:44.847720 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 420/823] 10.222.0.104 () {58 vars in 1420 bytes} [Thu Oct 28 09:54:44 2021] DELETE /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/os-volume_attachments/e609d58c-714a-43aa-8d34-f6ba2df0392f => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 09:54:44.995676 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-f27fe285-c312-454d-becf-315061cd2720 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:44.996607 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-f27fe285-c312-454d-becf-315061cd2720 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:45.006110 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f27fe285-c312-454d-becf-315061cd2720 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:45.006547 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f27fe285-c312-454d-becf-315061cd2720 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:45.007317 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f27fe285-c312-454d-becf-315061cd2720 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:45.007734 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f27fe285-c312-454d-becf-315061cd2720 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:45.134561 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-f27fe285-c312-454d-becf-315061cd2720 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:45.142575 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-f27fe285-c312-454d-becf-315061cd2720 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:45.144054 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-f27fe285-c312-454d-becf-315061cd2720 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:45.145391 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-f27fe285-c312-454d-becf-315061cd2720 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1728 microversion: 2.20 time: 0.153704 Oct 28 09:54:45.145943 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 404/824] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:54:44 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:54:45.526758 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-d6382638-baec-400f-b250-3c9735fd829a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:45.527650 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-d6382638-baec-400f-b250-3c9735fd829a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:45.534651 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d6382638-baec-400f-b250-3c9735fd829a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:45.535097 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d6382638-baec-400f-b250-3c9735fd829a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:45.535885 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d6382638-baec-400f-b250-3c9735fd829a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:45.536310 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d6382638-baec-400f-b250-3c9735fd829a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:45.669826 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-d6382638-baec-400f-b250-3c9735fd829a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:45.677685 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-d6382638-baec-400f-b250-3c9735fd829a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1572 microversion: 2.1 time: 0.155043 Oct 28 09:54:45.678278 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 421/825] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:54:45 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1572 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:46.017902 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-aea3a0b4-61c6-4888-b625-d9898ad95119 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:46.018910 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-aea3a0b4-61c6-4888-b625-d9898ad95119 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:46.026212 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-aea3a0b4-61c6-4888-b625-d9898ad95119 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:46.026664 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-aea3a0b4-61c6-4888-b625-d9898ad95119 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:46.027429 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-aea3a0b4-61c6-4888-b625-d9898ad95119 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:46.027846 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-aea3a0b4-61c6-4888-b625-d9898ad95119 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:46.059052 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-aea3a0b4-61c6-4888-b625-d9898ad95119 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046181 Oct 28 09:54:46.059628 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 405/826] 10.222.0.104 () {58 vars in 1306 bytes} [Thu Oct 28 09:54:46 2021] GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:54:46.169789 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-4dbf91c0-6649-4675-bb06-4f28c4f46266 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:46.170428 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-4dbf91c0-6649-4675-bb06-4f28c4f46266 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:46.173732 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-13ab5f98-c2b0-4960-9860-31bc436b9e9a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:46.179202 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-13ab5f98-c2b0-4960-9860-31bc436b9e9a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:46.179354 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4dbf91c0-6649-4675-bb06-4f28c4f46266 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:46.179354 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4dbf91c0-6649-4675-bb06-4f28c4f46266 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:46.179354 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4dbf91c0-6649-4675-bb06-4f28c4f46266 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:46.179354 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4dbf91c0-6649-4675-bb06-4f28c4f46266 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:46.181265 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-13ab5f98-c2b0-4960-9860-31bc436b9e9a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:46.181703 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-13ab5f98-c2b0-4960-9860-31bc436b9e9a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:46.182463 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-13ab5f98-c2b0-4960-9860-31bc436b9e9a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:46.182905 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-13ab5f98-c2b0-4960-9860-31bc436b9e9a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:46.216544 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-13ab5f98-c2b0-4960-9860-31bc436b9e9a tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046899 Oct 28 09:54:46.218233 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 406/827] 10.222.0.104 () {58 vars in 1306 bytes} [Thu Oct 28 09:54:46 2021] GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 09:54:46.276718 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-05942584-1d34-425b-ac85-6bcf6554685c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:46.277211 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-05942584-1d34-425b-ac85-6bcf6554685c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:46.283555 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-05942584-1d34-425b-ac85-6bcf6554685c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:46.283990 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-05942584-1d34-425b-ac85-6bcf6554685c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:46.284807 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-05942584-1d34-425b-ac85-6bcf6554685c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:46.285241 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-05942584-1d34-425b-ac85-6bcf6554685c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:46.311040 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-4dbf91c0-6649-4675-bb06-4f28c4f46266 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:46.311246 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-05942584-1d34-425b-ac85-6bcf6554685c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Going to try to terminate instance {{(pid=123068) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 09:54:46.319143 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-4dbf91c0-6649-4675-bb06-4f28c4f46266 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:46.320725 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-4dbf91c0-6649-4675-bb06-4f28c4f46266 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:46.321870 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-4dbf91c0-6649-4675-bb06-4f28c4f46266 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1728 microversion: 2.20 time: 0.156296 Oct 28 09:54:46.322431 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 422/828] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:54:46 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:54:46.682575 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-05942584-1d34-425b-ac85-6bcf6554685c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "DELETE /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f" status: 204 len: 0 microversion: 2.1 time: 0.409098 Oct 28 09:54:46.683181 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 407/829] 10.222.0.104 () {58 vars in 1243 bytes} [Thu Oct 28 09:54:46 2021] DELETE /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 09:54:46.692019 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-3d2fcbb1-d65a-49f0-af37-cb4fef6f56a7 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:46.692638 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-3d2fcbb1-d65a-49f0-af37-cb4fef6f56a7 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:46.699480 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3d2fcbb1-d65a-49f0-af37-cb4fef6f56a7 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:46.699690 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-59b966f7-798c-4628-bde0-aaae6ff8612d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:46.700015 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3d2fcbb1-d65a-49f0-af37-cb4fef6f56a7 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:46.700363 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-59b966f7-798c-4628-bde0-aaae6ff8612d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:46.701531 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3d2fcbb1-d65a-49f0-af37-cb4fef6f56a7 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:46.702110 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3d2fcbb1-d65a-49f0-af37-cb4fef6f56a7 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:46.708089 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-59b966f7-798c-4628-bde0-aaae6ff8612d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:46.708842 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-59b966f7-798c-4628-bde0-aaae6ff8612d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:46.709920 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-59b966f7-798c-4628-bde0-aaae6ff8612d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:46.710517 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-59b966f7-798c-4628-bde0-aaae6ff8612d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:46.897299 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-3d2fcbb1-d65a-49f0-af37-cb4fef6f56a7 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:46.902475 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-59b966f7-798c-4628-bde0-aaae6ff8612d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:46.906491 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-3d2fcbb1-d65a-49f0-af37-cb4fef6f56a7 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f" status: 200 len: 1675 microversion: 2.1 time: 0.218195 Oct 28 09:54:46.907498 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 423/830] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:54:46 2021] GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f => generated 1675 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:46.918810 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-59b966f7-798c-4628-bde0-aaae6ff8612d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1572 microversion: 2.1 time: 0.223142 Oct 28 09:54:46.920133 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 408/831] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:54:46 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1572 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:47.341075 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-13436e46-aff7-41e8-874d-cd8337719501 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:47.342222 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-13436e46-aff7-41e8-874d-cd8337719501 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:47.348838 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-13436e46-aff7-41e8-874d-cd8337719501 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:47.349300 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-13436e46-aff7-41e8-874d-cd8337719501 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:47.350040 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-13436e46-aff7-41e8-874d-cd8337719501 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:47.350466 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-13436e46-aff7-41e8-874d-cd8337719501 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:47.499950 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-13436e46-aff7-41e8-874d-cd8337719501 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:47.508722 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-13436e46-aff7-41e8-874d-cd8337719501 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:47.510203 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-13436e46-aff7-41e8-874d-cd8337719501 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:47.511840 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-13436e46-aff7-41e8-874d-cd8337719501 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1728 microversion: 2.20 time: 0.175088 Oct 28 09:54:47.512413 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 424/832] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:54:47 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:54:47.923743 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-fd86f806-159d-4b02-b1e1-8779480aa08b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:47.924388 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-fd86f806-159d-4b02-b1e1-8779480aa08b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:47.932874 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fd86f806-159d-4b02-b1e1-8779480aa08b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:47.942736 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fd86f806-159d-4b02-b1e1-8779480aa08b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:47.942736 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fd86f806-159d-4b02-b1e1-8779480aa08b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:47.942736 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fd86f806-159d-4b02-b1e1-8779480aa08b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:47.943233 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-29262540-fa73-4150-934a-eab33c40e450 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:47.943233 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-29262540-fa73-4150-934a-eab33c40e450 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:47.948370 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-29262540-fa73-4150-934a-eab33c40e450 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:47.949012 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-29262540-fa73-4150-934a-eab33c40e450 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:47.949990 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-29262540-fa73-4150-934a-eab33c40e450 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:47.950513 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-29262540-fa73-4150-934a-eab33c40e450 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:48.132753 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-fd86f806-159d-4b02-b1e1-8779480aa08b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:48.137841 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-29262540-fa73-4150-934a-eab33c40e450 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:48.144555 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-fd86f806-159d-4b02-b1e1-8779480aa08b tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f" status: 200 len: 1675 microversion: 2.1 time: 0.224469 Oct 28 09:54:48.148629 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 409/833] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:54:47 2021] GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f => generated 1675 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:48.148839 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-29262540-fa73-4150-934a-eab33c40e450 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1572 microversion: 2.1 time: 0.213435 Oct 28 09:54:48.148839 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 425/834] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:54:47 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1572 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:48.533162 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-4c0724c1-2148-44c5-adcd-74e1988fef0a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:48.533771 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-4c0724c1-2148-44c5-adcd-74e1988fef0a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:48.540679 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4c0724c1-2148-44c5-adcd-74e1988fef0a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:48.541132 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4c0724c1-2148-44c5-adcd-74e1988fef0a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:48.541960 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4c0724c1-2148-44c5-adcd-74e1988fef0a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:48.542384 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4c0724c1-2148-44c5-adcd-74e1988fef0a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:48.704709 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-4c0724c1-2148-44c5-adcd-74e1988fef0a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:48.713932 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-4c0724c1-2148-44c5-adcd-74e1988fef0a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:48.715539 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-4c0724c1-2148-44c5-adcd-74e1988fef0a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:48.717498 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-4c0724c1-2148-44c5-adcd-74e1988fef0a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1749 microversion: 2.20 time: 0.189070 Oct 28 09:54:48.718086 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 410/835] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:54:48 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1749 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:54:49.165226 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-5909a535-9d5c-4eb8-9ab2-a5474fec7791 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:49.166053 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-bbb2b040-e05d-4ceb-808b-13def174b3ed tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:49.166780 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-5909a535-9d5c-4eb8-9ab2-a5474fec7791 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:49.166919 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-bbb2b040-e05d-4ceb-808b-13def174b3ed tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:49.173578 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bbb2b040-e05d-4ceb-808b-13def174b3ed tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:49.174018 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bbb2b040-e05d-4ceb-808b-13def174b3ed tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:49.174816 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bbb2b040-e05d-4ceb-808b-13def174b3ed tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:49.175240 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bbb2b040-e05d-4ceb-808b-13def174b3ed tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:49.176390 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5909a535-9d5c-4eb8-9ab2-a5474fec7791 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:49.177177 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5909a535-9d5c-4eb8-9ab2-a5474fec7791 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:49.178463 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5909a535-9d5c-4eb8-9ab2-a5474fec7791 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:49.179194 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5909a535-9d5c-4eb8-9ab2-a5474fec7791 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:49.377949 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-bbb2b040-e05d-4ceb-808b-13def174b3ed tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:49.388286 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-5909a535-9d5c-4eb8-9ab2-a5474fec7791 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:49.396795 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-5909a535-9d5c-4eb8-9ab2-a5474fec7791 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f" status: 200 len: 1675 microversion: 2.1 time: 0.236424 Oct 28 09:54:49.398387 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-bbb2b040-e05d-4ceb-808b-13def174b3ed tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1572 microversion: 2.1 time: 0.235663 Oct 28 09:54:49.399982 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 411/836] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:54:49 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1572 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:54:49.402939 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 426/837] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:54:49 2021] GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f => generated 1675 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:49.704226 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-7267e6b7-e615-4272-ba34-e81ecaa71db1 req-0fade343-a5f7-4c3e-881a-9f0e08644493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "914bc218-ac76-4448-82e3-f4059c8f8a8f", "name": "network-vif-deleted", "tag": "58893e81-1ce4-483e-b6b0-b386c74b972a"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:49.705821 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:54:49.705821 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:54:49.715335 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-7267e6b7-e615-4272-ba34-e81ecaa71db1 req-0fade343-a5f7-4c3e-881a-9f0e08644493 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:49.716098 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-7267e6b7-e615-4272-ba34-e81ecaa71db1 req-0fade343-a5f7-4c3e-881a-9f0e08644493 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:49.734787 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-7267e6b7-e615-4272-ba34-e81ecaa71db1 req-0fade343-a5f7-4c3e-881a-9f0e08644493 service nova] Creating event network-vif-deleted:58893e81-1ce4-483e-b6b0-b386c74b972a for instance 914bc218-ac76-4448-82e3-f4059c8f8a8f on hv-cinder-81571 Oct 28 09:54:49.741966 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-c989741c-edd0-45f0-b024-804e73337101 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:49.747618 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-7267e6b7-e615-4272-ba34-e81ecaa71db1 req-0fade343-a5f7-4c3e-881a-9f0e08644493 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039932 Oct 28 09:54:49.748278 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-c989741c-edd0-45f0-b024-804e73337101 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:49.748377 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 412/838] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:54:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:54:49.753502 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c989741c-edd0-45f0-b024-804e73337101 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:49.755047 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c989741c-edd0-45f0-b024-804e73337101 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:49.755194 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c989741c-edd0-45f0-b024-804e73337101 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:49.755736 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c989741c-edd0-45f0-b024-804e73337101 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:49.974696 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-c989741c-edd0-45f0-b024-804e73337101 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:49.984481 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-c989741c-edd0-45f0-b024-804e73337101 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:49.986531 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-c989741c-edd0-45f0-b024-804e73337101 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:49.988526 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-c989741c-edd0-45f0-b024-804e73337101 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1749 microversion: 2.20 time: 0.252336 Oct 28 09:54:49.989279 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 427/839] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:54:49 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1749 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:54:50.420496 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-64ae742e-522b-4a1e-808b-a3d042ca9e82 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:50.421545 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-64ae742e-522b-4a1e-808b-a3d042ca9e82 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:50.430307 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-64ae742e-522b-4a1e-808b-a3d042ca9e82 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:50.431033 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-64ae742e-522b-4a1e-808b-a3d042ca9e82 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:50.432463 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-64ae742e-522b-4a1e-808b-a3d042ca9e82 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:50.433238 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-64ae742e-522b-4a1e-808b-a3d042ca9e82 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:50.436413 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-86bfd1e6-fe37-4841-bc99-3d7b2fcd46fe tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:50.437688 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-86bfd1e6-fe37-4841-bc99-3d7b2fcd46fe tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:50.444506 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-86bfd1e6-fe37-4841-bc99-3d7b2fcd46fe tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:50.445881 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-86bfd1e6-fe37-4841-bc99-3d7b2fcd46fe tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:50.446251 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-86bfd1e6-fe37-4841-bc99-3d7b2fcd46fe tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:50.446815 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-86bfd1e6-fe37-4841-bc99-3d7b2fcd46fe tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:50.497221 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-86bfd1e6-fe37-4841-bc99-3d7b2fcd46fe tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:50.498385 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-86bfd1e6-fe37-4841-bc99-3d7b2fcd46fe tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:50.499231 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.objects.instance [None req-86bfd1e6-fe37-4841-bc99-3d7b2fcd46fe tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lazy-loading 'fault' on Instance uuid 914bc218-ac76-4448-82e3-f4059c8f8a8f {{(pid=123069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 09:54:50.647094 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-86bfd1e6-fe37-4841-bc99-3d7b2fcd46fe tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62731dd3e3c54a73b941292530dfa850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d7839b812b745549a72a1e089b6f4e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:50.669582 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-86bfd1e6-fe37-4841-bc99-3d7b2fcd46fe tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f" status: 200 len: 1330 microversion: 2.1 time: 0.237899 Oct 28 09:54:50.673377 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 428/840] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:54:50 2021] GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f => generated 1330 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:50.782295 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-64ae742e-522b-4a1e-808b-a3d042ca9e82 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:50.790472 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-64ae742e-522b-4a1e-808b-a3d042ca9e82 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1573 microversion: 2.1 time: 0.376141 Oct 28 09:54:50.791325 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 413/841] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:54:50 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1573 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:54:50.812606 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-12f14fb9-d3d6-46cd-92dd-a5b503257fd9 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:50.813109 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-12f14fb9-d3d6-46cd-92dd-a5b503257fd9 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:50.820625 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-12f14fb9-d3d6-46cd-92dd-a5b503257fd9 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:50.821228 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-12f14fb9-d3d6-46cd-92dd-a5b503257fd9 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:50.822515 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-12f14fb9-d3d6-46cd-92dd-a5b503257fd9 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:50.823029 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-12f14fb9-d3d6-46cd-92dd-a5b503257fd9 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:51.021520 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-3c18940e-1f6d-4e07-9e21-c0d6a002485f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:51.022181 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-3c18940e-1f6d-4e07-9e21-c0d6a002485f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:51.035662 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3c18940e-1f6d-4e07-9e21-c0d6a002485f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:51.035885 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3c18940e-1f6d-4e07-9e21-c0d6a002485f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:51.037200 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3c18940e-1f6d-4e07-9e21-c0d6a002485f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:51.038083 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3c18940e-1f6d-4e07-9e21-c0d6a002485f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:51.245024 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-3c18940e-1f6d-4e07-9e21-c0d6a002485f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:51.257393 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-3c18940e-1f6d-4e07-9e21-c0d6a002485f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:51.259336 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-3c18940e-1f6d-4e07-9e21-c0d6a002485f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:51.260956 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-3c18940e-1f6d-4e07-9e21-c0d6a002485f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1744 microversion: 2.20 time: 0.253819 Oct 28 09:54:51.262473 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 414/842] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:54:51 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1744 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:54:51.315381 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-12f14fb9-d3d6-46cd-92dd-a5b503257fd9 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "POST /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27/action" status: 202 len: 0 microversion: 2.1 time: 0.505449 Oct 28 09:54:51.322464 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 429/843] 10.222.0.104 () {60 vars in 1282 bytes} [Thu Oct 28 09:54:50 2021] POST /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27/action => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 09:54:51.329563 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-b8158b82-e3d7-4060-85de-20336573f72a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:51.330270 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-b8158b82-e3d7-4060-85de-20336573f72a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:51.341949 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b8158b82-e3d7-4060-85de-20336573f72a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:51.341949 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b8158b82-e3d7-4060-85de-20336573f72a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:51.343328 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b8158b82-e3d7-4060-85de-20336573f72a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:51.343892 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b8158b82-e3d7-4060-85de-20336573f72a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:51.576720 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-b8158b82-e3d7-4060-85de-20336573f72a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:51.590801 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-b8158b82-e3d7-4060-85de-20336573f72a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1521 microversion: 2.1 time: 0.266286 Oct 28 09:54:51.592053 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 415/844] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:54:51 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:54:51.692834 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-162edd73-b771-461e-a828-9621951fdc0c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:51.695527 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-162edd73-b771-461e-a828-9621951fdc0c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:51.710417 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-162edd73-b771-461e-a828-9621951fdc0c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:51.711837 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-162edd73-b771-461e-a828-9621951fdc0c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:51.713298 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-162edd73-b771-461e-a828-9621951fdc0c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:51.713995 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-162edd73-b771-461e-a828-9621951fdc0c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:51.737923 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.wsgi [None req-162edd73-b771-461e-a828-9621951fdc0c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] HTTP exception thrown: Instance 914bc218-ac76-4448-82e3-f4059c8f8a8f could not be found. Oct 28 09:54:51.739156 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-162edd73-b771-461e-a828-9621951fdc0c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Returning 404 to user: Instance 914bc218-ac76-4448-82e3-f4059c8f8a8f could not be found. {{(pid=123069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:54:51.740538 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-162edd73-b771-461e-a828-9621951fdc0c tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f" status: 404 len: 111 microversion: 2.1 time: 0.052418 Oct 28 09:54:51.741719 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 430/845] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:54:51 2021] GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:54:51.752755 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-d05d0be0-2e6c-4c1f-ace9-1be9e0ba5e8d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '.version_select at 0x7fe121c4aca0>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:51.862920 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-d05d0be0-2e6c-4c1f-ace9-1be9e0ba5e8d tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-672342344" status: 202 len: 0 microversion: 2.1 time: 0.115655 Oct 28 09:54:51.863936 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 416/846] 10.222.0.104 () {58 vars in 1222 bytes} [Thu Oct 28 09:54:51 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-672342344 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:54:52.288143 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-c2d8720c-30d3-47cd-88db-35a5c796131a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:52.291433 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-c2d8720c-30d3-47cd-88db-35a5c796131a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:52.302899 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c2d8720c-30d3-47cd-88db-35a5c796131a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:52.303651 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c2d8720c-30d3-47cd-88db-35a5c796131a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:52.304678 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c2d8720c-30d3-47cd-88db-35a5c796131a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:52.305478 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c2d8720c-30d3-47cd-88db-35a5c796131a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:52.633025 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-38429bbe-c9df-4acf-8786-dd64103515e0 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:52.636025 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-38429bbe-c9df-4acf-8786-dd64103515e0 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:52.661924 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-38429bbe-c9df-4acf-8786-dd64103515e0 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:52.666646 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-38429bbe-c9df-4acf-8786-dd64103515e0 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:52.667566 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-38429bbe-c9df-4acf-8786-dd64103515e0 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:52.668011 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-38429bbe-c9df-4acf-8786-dd64103515e0 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:53.073797 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-c2d8720c-30d3-47cd-88db-35a5c796131a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:53.105152 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-c2d8720c-30d3-47cd-88db-35a5c796131a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:53.115778 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-c2d8720c-30d3-47cd-88db-35a5c796131a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:53.119200 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-c2d8720c-30d3-47cd-88db-35a5c796131a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1744 microversion: 2.20 time: 0.836485 Oct 28 09:54:53.121228 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 431/847] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:54:52 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1744 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:54:53.199680 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-38429bbe-c9df-4acf-8786-dd64103515e0 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:53.232804 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-38429bbe-c9df-4acf-8786-dd64103515e0 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1521 microversion: 2.1 time: 0.615738 Oct 28 09:54:53.235224 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 417/848] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:54:52 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1521 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:53.415160 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [req-07d1e789-0a6c-4406-9c37-c92c16b72c1e req-994d6aa5-cde4-429c-b16d-0e06f4eb1e8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f18b00b-bb81-40c2-96fc-aeb3627b6028", "name": "network-vif-plugged", "status": "completed", "tag": "15410dad-2493-48fa-8bb6-cbde6b1a0ab5"}]} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:53.417672 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:54:53.417672 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 09:54:53.425635 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-07d1e789-0a6c-4406-9c37-c92c16b72c1e req-994d6aa5-cde4-429c-b16d-0e06f4eb1e8f service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:53.426647 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-07d1e789-0a6c-4406-9c37-c92c16b72c1e req-994d6aa5-cde4-429c-b16d-0e06f4eb1e8f service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:53.442255 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.compute.server_external_events [req-07d1e789-0a6c-4406-9c37-c92c16b72c1e req-994d6aa5-cde4-429c-b16d-0e06f4eb1e8f service nova] Creating event network-vif-plugged:15410dad-2493-48fa-8bb6-cbde6b1a0ab5 for instance 4f18b00b-bb81-40c2-96fc-aeb3627b6028 on hv-cinder-81571 Oct 28 09:54:53.448031 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [req-07d1e789-0a6c-4406-9c37-c92c16b72c1e req-994d6aa5-cde4-429c-b16d-0e06f4eb1e8f service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.324342 Oct 28 09:54:53.449380 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 432/849] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:54:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:54:54.162074 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-5eb6e307-3aa4-4324-8491-d13feb7217c5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:54.163591 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-5eb6e307-3aa4-4324-8491-d13feb7217c5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:54.176247 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5eb6e307-3aa4-4324-8491-d13feb7217c5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:54.177562 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5eb6e307-3aa4-4324-8491-d13feb7217c5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:54.179116 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5eb6e307-3aa4-4324-8491-d13feb7217c5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:54.180058 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5eb6e307-3aa4-4324-8491-d13feb7217c5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:54.261033 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-e5f48906-8f90-4dfe-bc6a-eaa1f187943a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:54.263345 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-e5f48906-8f90-4dfe-bc6a-eaa1f187943a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:54.274163 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e5f48906-8f90-4dfe-bc6a-eaa1f187943a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:54.275530 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e5f48906-8f90-4dfe-bc6a-eaa1f187943a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:54.277274 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e5f48906-8f90-4dfe-bc6a-eaa1f187943a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:54.278393 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e5f48906-8f90-4dfe-bc6a-eaa1f187943a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:54.601835 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-5eb6e307-3aa4-4324-8491-d13feb7217c5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:54.632238 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-e5f48906-8f90-4dfe-bc6a-eaa1f187943a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:54.636039 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-5eb6e307-3aa4-4324-8491-d13feb7217c5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:54.640797 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-5eb6e307-3aa4-4324-8491-d13feb7217c5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:54.648741 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-e5f48906-8f90-4dfe-bc6a-eaa1f187943a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1523 microversion: 2.1 time: 0.392670 Oct 28 09:54:54.649817 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 433/850] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:54:54 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1523 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:54.652024 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-5eb6e307-3aa4-4324-8491-d13feb7217c5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1744 microversion: 2.20 time: 0.500052 Oct 28 09:54:54.665326 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 418/851] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:54:54 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1744 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:54:55.464474 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [req-bfee934b-7737-411f-a88e-a71739b3214a req-be9a2b44-ed2a-4ad0-a0cd-aa4b73ce36ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a28831e5-4c0c-4dd9-bf92-ccf43a500b27", "name": "network-vif-unplugged", "status": "completed", "tag": "94cbd2b9-09d8-4c85-ab69-0e95ad1404ee"}]} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:55.465774 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:54:55.465774 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 09:54:55.477445 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-bfee934b-7737-411f-a88e-a71739b3214a req-be9a2b44-ed2a-4ad0-a0cd-aa4b73ce36ab service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:55.478165 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-bfee934b-7737-411f-a88e-a71739b3214a req-be9a2b44-ed2a-4ad0-a0cd-aa4b73ce36ab service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:55.500623 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.compute.server_external_events [req-bfee934b-7737-411f-a88e-a71739b3214a req-be9a2b44-ed2a-4ad0-a0cd-aa4b73ce36ab service nova] Creating event network-vif-unplugged:94cbd2b9-09d8-4c85-ab69-0e95ad1404ee for instance a28831e5-4c0c-4dd9-bf92-ccf43a500b27 on hv-cinder-81571 Oct 28 09:54:55.510947 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [req-bfee934b-7737-411f-a88e-a71739b3214a req-be9a2b44-ed2a-4ad0-a0cd-aa4b73ce36ab service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049936 Oct 28 09:54:55.512109 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 434/852] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:54:55 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:54:55.671329 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-47fde95c-e490-4066-8106-7b55af26322f tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:55.672500 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-47fde95c-e490-4066-8106-7b55af26322f tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:55.681913 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-c99d4a92-fed6-46c5-ab13-b455890c1a02 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:55.682818 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-c99d4a92-fed6-46c5-ab13-b455890c1a02 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:55.685302 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-47fde95c-e490-4066-8106-7b55af26322f tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:55.686980 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-47fde95c-e490-4066-8106-7b55af26322f tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:55.688468 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-47fde95c-e490-4066-8106-7b55af26322f tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:55.689541 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-47fde95c-e490-4066-8106-7b55af26322f tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:55.691953 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c99d4a92-fed6-46c5-ab13-b455890c1a02 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:55.692342 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c99d4a92-fed6-46c5-ab13-b455890c1a02 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:55.693344 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c99d4a92-fed6-46c5-ab13-b455890c1a02 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:55.693781 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c99d4a92-fed6-46c5-ab13-b455890c1a02 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:55.908048 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-47fde95c-e490-4066-8106-7b55af26322f tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:55.917920 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-47fde95c-e490-4066-8106-7b55af26322f tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1579 microversion: 2.1 time: 0.252934 Oct 28 09:54:55.920425 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 419/853] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:54:55 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1579 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:55.923851 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-c99d4a92-fed6-46c5-ab13-b455890c1a02 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:55.935531 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-c99d4a92-fed6-46c5-ab13-b455890c1a02 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:55.937696 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-c99d4a92-fed6-46c5-ab13-b455890c1a02 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:55.938905 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-c99d4a92-fed6-46c5-ab13-b455890c1a02 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1744 microversion: 2.20 time: 0.261219 Oct 28 09:54:55.939481 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 435/854] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:54:55 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1744 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:54:56.457482 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-b19bdb63-f675-48ee-87c6-5514ab37b103 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:56.458150 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-b19bdb63-f675-48ee-87c6-5514ab37b103 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:56.468285 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b19bdb63-f675-48ee-87c6-5514ab37b103 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:56.485207 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b19bdb63-f675-48ee-87c6-5514ab37b103 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:56.485207 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b19bdb63-f675-48ee-87c6-5514ab37b103 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:56.485207 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b19bdb63-f675-48ee-87c6-5514ab37b103 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:56.511085 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.wsgi [None req-b19bdb63-f675-48ee-87c6-5514ab37b103 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] HTTP exception thrown: Instance 914bc218-ac76-4448-82e3-f4059c8f8a8f could not be found. Oct 28 09:54:56.512393 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-b19bdb63-f675-48ee-87c6-5514ab37b103 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Returning 404 to user: Instance 914bc218-ac76-4448-82e3-f4059c8f8a8f could not be found. {{(pid=123068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:54:56.515014 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-b19bdb63-f675-48ee-87c6-5514ab37b103 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "DELETE /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f" status: 404 len: 111 microversion: 2.1 time: 0.064693 Oct 28 09:54:56.516527 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 420/855] 10.222.0.104 () {58 vars in 1243 bytes} [Thu Oct 28 09:54:56 2021] DELETE /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:54:56.530200 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-78a9eca0-ef9d-4703-8508-e33d3d67481f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:56.546048 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-78a9eca0-ef9d-4703-8508-e33d3d67481f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 914bc218-ac76-4448-82e3-f4059c8f8a8f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:56.546048 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-78a9eca0-ef9d-4703-8508-e33d3d67481f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:56.547420 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-78a9eca0-ef9d-4703-8508-e33d3d67481f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:56.550461 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-78a9eca0-ef9d-4703-8508-e33d3d67481f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:56.551373 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-78a9eca0-ef9d-4703-8508-e33d3d67481f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:56.585112 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.wsgi [None req-78a9eca0-ef9d-4703-8508-e33d3d67481f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] HTTP exception thrown: Instance 914bc218-ac76-4448-82e3-f4059c8f8a8f could not be found. Oct 28 09:54:56.586129 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-78a9eca0-ef9d-4703-8508-e33d3d67481f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Returning 404 to user: Instance 914bc218-ac76-4448-82e3-f4059c8f8a8f could not be found. {{(pid=123069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:54:56.587546 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-78a9eca0-ef9d-4703-8508-e33d3d67481f tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f" status: 404 len: 111 microversion: 2.1 time: 0.065968 Oct 28 09:54:56.588513 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 436/856] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:54:56 2021] GET /compute/v2.1/servers/914bc218-ac76-4448-82e3-f4059c8f8a8f => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:54:56.941420 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-aed3933a-7708-4694-8378-518589a1851d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:56.942731 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-aed3933a-7708-4694-8378-518589a1851d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:56.949671 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-aed3933a-7708-4694-8378-518589a1851d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:56.951146 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-aed3933a-7708-4694-8378-518589a1851d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:56.952995 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-aed3933a-7708-4694-8378-518589a1851d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:56.953584 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-aed3933a-7708-4694-8378-518589a1851d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:56.957652 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-96f28fe8-ea47-4d3f-bce4-5353060ddf27 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:56.958610 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-96f28fe8-ea47-4d3f-bce4-5353060ddf27 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:56.964901 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-96f28fe8-ea47-4d3f-bce4-5353060ddf27 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:56.965611 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-96f28fe8-ea47-4d3f-bce4-5353060ddf27 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:56.967388 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-96f28fe8-ea47-4d3f-bce4-5353060ddf27 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:56.967893 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-96f28fe8-ea47-4d3f-bce4-5353060ddf27 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:57.172574 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-aed3933a-7708-4694-8378-518589a1851d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:57.180537 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-aed3933a-7708-4694-8378-518589a1851d tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1579 microversion: 2.1 time: 0.242569 Oct 28 09:54:57.191110 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 421/857] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:54:56 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1579 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:57.191350 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-96f28fe8-ea47-4d3f-bce4-5353060ddf27 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:57.194242 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-96f28fe8-ea47-4d3f-bce4-5353060ddf27 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:57.195924 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-96f28fe8-ea47-4d3f-bce4-5353060ddf27 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:57.197304 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-96f28fe8-ea47-4d3f-bce4-5353060ddf27 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1744 microversion: 2.20 time: 0.243470 Oct 28 09:54:57.197928 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 437/858] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:54:56 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1744 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:54:57.969797 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-44beef04-cc62-4ded-bad7-549f5b615ac9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:57.971441 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-44beef04-cc62-4ded-bad7-549f5b615ac9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:57.978040 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-44beef04-cc62-4ded-bad7-549f5b615ac9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:57.978623 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-44beef04-cc62-4ded-bad7-549f5b615ac9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:57.979507 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-44beef04-cc62-4ded-bad7-549f5b615ac9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:57.980185 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-44beef04-cc62-4ded-bad7-549f5b615ac9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:57.995922 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.wsgi [None req-44beef04-cc62-4ded-bad7-549f5b615ac9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] HTTP exception thrown: Instance 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 could not be found. Oct 28 09:54:57.996957 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-44beef04-cc62-4ded-bad7-549f5b615ac9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Returning 404 to user: Instance 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 could not be found. {{(pid=123068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:54:57.998660 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-44beef04-cc62-4ded-bad7-549f5b615ac9 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "DELETE /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 404 len: 111 microversion: 2.1 time: 0.033756 Oct 28 09:54:57.999509 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 422/859] 10.222.0.104 () {58 vars in 1243 bytes} [Thu Oct 28 09:54:57 2021] DELETE /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:54:58.007982 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-cabf43db-ba99-45ad-9926-4e9955038346 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:58.008835 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-cabf43db-ba99-45ad-9926-4e9955038346 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] [instance: 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:58.016387 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-cabf43db-ba99-45ad-9926-4e9955038346 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:58.017011 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-cabf43db-ba99-45ad-9926-4e9955038346 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:58.018049 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-cabf43db-ba99-45ad-9926-4e9955038346 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:58.018730 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-cabf43db-ba99-45ad-9926-4e9955038346 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:58.035962 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.wsgi [None req-cabf43db-ba99-45ad-9926-4e9955038346 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] HTTP exception thrown: Instance 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 could not be found. Oct 28 09:54:58.036831 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-cabf43db-ba99-45ad-9926-4e9955038346 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] Returning 404 to user: Instance 4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 could not be found. {{(pid=123069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:54:58.037985 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-cabf43db-ba99-45ad-9926-4e9955038346 tempest-AttachVolumeTestJSON-1397880198 tempest-AttachVolumeTestJSON-1397880198-project] 10.222.0.104 "GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4" status: 404 len: 111 microversion: 2.1 time: 0.033791 Oct 28 09:54:58.038702 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 438/860] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:54:58 2021] GET /compute/v2.1/servers/4a4e433d-b808-4128-9e1e-cd8f5f7e20f4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:54:58.199402 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-21a540b4-362f-4350-bc02-14034b381110 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:58.201556 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-21a540b4-362f-4350-bc02-14034b381110 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:58.209147 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-21a540b4-362f-4350-bc02-14034b381110 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:58.210371 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-21a540b4-362f-4350-bc02-14034b381110 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:58.212466 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-21a540b4-362f-4350-bc02-14034b381110 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:58.213284 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-21a540b4-362f-4350-bc02-14034b381110 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:58.221207 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-14604d11-770f-4fef-a907-9063dc27bf6d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:58.222461 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-14604d11-770f-4fef-a907-9063dc27bf6d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:58.232386 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-14604d11-770f-4fef-a907-9063dc27bf6d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:58.233458 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-14604d11-770f-4fef-a907-9063dc27bf6d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:58.235037 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-14604d11-770f-4fef-a907-9063dc27bf6d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:58.235996 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-14604d11-770f-4fef-a907-9063dc27bf6d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:58.577014 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-21a540b4-362f-4350-bc02-14034b381110 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:58.588845 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-21a540b4-362f-4350-bc02-14034b381110 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1579 microversion: 2.1 time: 0.393355 Oct 28 09:54:58.589451 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-14604d11-770f-4fef-a907-9063dc27bf6d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:58.602034 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-14604d11-770f-4fef-a907-9063dc27bf6d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:58.602945 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 423/861] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:54:58 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1579 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:58.606731 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-14604d11-770f-4fef-a907-9063dc27bf6d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:58.609986 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-14604d11-770f-4fef-a907-9063dc27bf6d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1744 microversion: 2.20 time: 0.394692 Oct 28 09:54:58.620536 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 439/862] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:54:58 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1744 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:54:59.621146 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-0a2ccb07-b245-4176-891e-70769d62167f tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:59.621807 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-0a2ccb07-b245-4176-891e-70769d62167f tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:59.629533 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0a2ccb07-b245-4176-891e-70769d62167f tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:59.629731 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-701bd5c6-e548-4b01-97eb-49f0f0955f99 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:59.630255 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0a2ccb07-b245-4176-891e-70769d62167f tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:59.630370 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-701bd5c6-e548-4b01-97eb-49f0f0955f99 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:54:59.630771 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0a2ccb07-b245-4176-891e-70769d62167f tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:59.631201 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0a2ccb07-b245-4176-891e-70769d62167f tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:59.637626 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-701bd5c6-e548-4b01-97eb-49f0f0955f99 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:59.638820 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-701bd5c6-e548-4b01-97eb-49f0f0955f99 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:54:59.639863 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-701bd5c6-e548-4b01-97eb-49f0f0955f99 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:54:59.640234 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-701bd5c6-e548-4b01-97eb-49f0f0955f99 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:00.008763 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-0a2ccb07-b245-4176-891e-70769d62167f tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:00.020897 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-0a2ccb07-b245-4176-891e-70769d62167f tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1579 microversion: 2.1 time: 0.403151 Oct 28 09:55:00.022247 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 424/863] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:54:59 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1579 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:00.043271 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-701bd5c6-e548-4b01-97eb-49f0f0955f99 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:00.066066 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-701bd5c6-e548-4b01-97eb-49f0f0955f99 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:00.067806 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-701bd5c6-e548-4b01-97eb-49f0f0955f99 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:00.069184 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-701bd5c6-e548-4b01-97eb-49f0f0955f99 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1744 microversion: 2.20 time: 0.444012 Oct 28 09:55:00.083397 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 440/864] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:54:59 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1744 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:55:01.049707 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-3555ae1b-fc57-4ccd-94a5-70d11b910a1c tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:01.050434 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-3555ae1b-fc57-4ccd-94a5-70d11b910a1c tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:55:01.063478 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3555ae1b-fc57-4ccd-94a5-70d11b910a1c tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:01.064309 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3555ae1b-fc57-4ccd-94a5-70d11b910a1c tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:01.068253 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3555ae1b-fc57-4ccd-94a5-70d11b910a1c tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:01.069250 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3555ae1b-fc57-4ccd-94a5-70d11b910a1c tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:01.089818 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-fdae69da-57c8-4564-9aa4-f824ef7d09e5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:01.093710 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-fdae69da-57c8-4564-9aa4-f824ef7d09e5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:55:01.102206 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fdae69da-57c8-4564-9aa4-f824ef7d09e5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:01.103880 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fdae69da-57c8-4564-9aa4-f824ef7d09e5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:01.104925 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fdae69da-57c8-4564-9aa4-f824ef7d09e5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:01.105630 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fdae69da-57c8-4564-9aa4-f824ef7d09e5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:01.462948 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-fdae69da-57c8-4564-9aa4-f824ef7d09e5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:01.480536 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-fdae69da-57c8-4564-9aa4-f824ef7d09e5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:01.495225 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-fdae69da-57c8-4564-9aa4-f824ef7d09e5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:01.500838 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-fdae69da-57c8-4564-9aa4-f824ef7d09e5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1744 microversion: 2.20 time: 0.415257 Oct 28 09:55:01.505047 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 441/865] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:55:01 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1744 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:55:01.522958 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-3555ae1b-fc57-4ccd-94a5-70d11b910a1c tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:01.541672 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-3555ae1b-fc57-4ccd-94a5-70d11b910a1c tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1579 microversion: 2.1 time: 0.495677 Oct 28 09:55:01.556454 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 425/866] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:55:01 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1579 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:02.529748 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-f8eb649d-048f-4a09-8137-f2c022dbf156 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:02.530926 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-f8eb649d-048f-4a09-8137-f2c022dbf156 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:55:02.545319 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f8eb649d-048f-4a09-8137-f2c022dbf156 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:02.546186 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f8eb649d-048f-4a09-8137-f2c022dbf156 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:02.547213 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f8eb649d-048f-4a09-8137-f2c022dbf156 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:02.548120 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f8eb649d-048f-4a09-8137-f2c022dbf156 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:02.568624 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-6e7a7b60-ee63-44b9-a006-9dc00a2c3945 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:02.569389 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-6e7a7b60-ee63-44b9-a006-9dc00a2c3945 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:55:02.593514 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6e7a7b60-ee63-44b9-a006-9dc00a2c3945 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:02.595675 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6e7a7b60-ee63-44b9-a006-9dc00a2c3945 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:02.598043 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6e7a7b60-ee63-44b9-a006-9dc00a2c3945 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:02.600398 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6e7a7b60-ee63-44b9-a006-9dc00a2c3945 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:03.502972 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-6e7a7b60-ee63-44b9-a006-9dc00a2c3945 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:03.518517 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-6e7a7b60-ee63-44b9-a006-9dc00a2c3945 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1579 microversion: 2.1 time: 0.954515 Oct 28 09:55:03.519622 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 426/867] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:55:02 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1579 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:03.534936 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-f8eb649d-048f-4a09-8137-f2c022dbf156 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:03.552779 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-f8eb649d-048f-4a09-8137-f2c022dbf156 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:03.554639 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-f8eb649d-048f-4a09-8137-f2c022dbf156 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:03.556005 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-f8eb649d-048f-4a09-8137-f2c022dbf156 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1744 microversion: 2.20 time: 1.031250 Oct 28 09:55:03.557103 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 442/868] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:55:02 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1744 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:04.536323 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-285b20c2-d975-490d-b403-1675691923d5 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:04.537053 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-285b20c2-d975-490d-b403-1675691923d5 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:55:04.553131 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-285b20c2-d975-490d-b403-1675691923d5 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:04.553933 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-285b20c2-d975-490d-b403-1675691923d5 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:04.555305 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-285b20c2-d975-490d-b403-1675691923d5 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:04.556056 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-285b20c2-d975-490d-b403-1675691923d5 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:04.575254 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-e1d0ec86-d1ff-42c3-85dd-69a0a4c42407 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:04.577134 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-e1d0ec86-d1ff-42c3-85dd-69a0a4c42407 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:55:04.584764 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e1d0ec86-d1ff-42c3-85dd-69a0a4c42407 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:04.585594 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e1d0ec86-d1ff-42c3-85dd-69a0a4c42407 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:04.586591 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e1d0ec86-d1ff-42c3-85dd-69a0a4c42407 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:04.587517 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e1d0ec86-d1ff-42c3-85dd-69a0a4c42407 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:04.857977 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-285b20c2-d975-490d-b403-1675691923d5 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:04.871225 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-e1d0ec86-d1ff-42c3-85dd-69a0a4c42407 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:04.874297 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-285b20c2-d975-490d-b403-1675691923d5 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1579 microversion: 2.1 time: 0.341162 Oct 28 09:55:04.885712 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-e1d0ec86-d1ff-42c3-85dd-69a0a4c42407 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:04.891874 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-e1d0ec86-d1ff-42c3-85dd-69a0a4c42407 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:04.893384 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-e1d0ec86-d1ff-42c3-85dd-69a0a4c42407 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1744 microversion: 2.20 time: 0.321769 Oct 28 09:55:04.896181 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 443/870] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:55:04 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1744 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:55:04.907452 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 427/870] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:55:04 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1579 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:04.976512 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [req-2ff72e40-0f23-40b5-8167-5400bde0ed90 req-ec2d72f2-72a8-42c8-bcd9-a9ee0187d8a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a28831e5-4c0c-4dd9-bf92-ccf43a500b27", "name": "network-vif-plugged", "status": "completed", "tag": "94cbd2b9-09d8-4c85-ab69-0e95ad1404ee"}]} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:04.978362 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:55:04.978362 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 09:55:04.986470 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-2ff72e40-0f23-40b5-8167-5400bde0ed90 req-ec2d72f2-72a8-42c8-bcd9-a9ee0187d8a1 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:04.987202 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-2ff72e40-0f23-40b5-8167-5400bde0ed90 req-ec2d72f2-72a8-42c8-bcd9-a9ee0187d8a1 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:04.999914 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.compute.server_external_events [req-2ff72e40-0f23-40b5-8167-5400bde0ed90 req-ec2d72f2-72a8-42c8-bcd9-a9ee0187d8a1 service nova] Creating event network-vif-plugged:94cbd2b9-09d8-4c85-ab69-0e95ad1404ee for instance a28831e5-4c0c-4dd9-bf92-ccf43a500b27 on hv-cinder-81571 Oct 28 09:55:05.008988 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [req-2ff72e40-0f23-40b5-8167-5400bde0ed90 req-ec2d72f2-72a8-42c8-bcd9-a9ee0187d8a1 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038416 Oct 28 09:55:05.010178 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 444/871] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:55:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:05.919914 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-c96cad06-8f3b-455f-83b8-025713e90707 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:05.921855 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-bdc931e3-f4f0-4846-95f1-d533840720a0 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:05.923381 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-bdc931e3-f4f0-4846-95f1-d533840720a0 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:55:05.930038 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-c96cad06-8f3b-455f-83b8-025713e90707 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:55:05.930249 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bdc931e3-f4f0-4846-95f1-d533840720a0 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:05.930670 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bdc931e3-f4f0-4846-95f1-d533840720a0 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:05.931663 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bdc931e3-f4f0-4846-95f1-d533840720a0 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:05.935578 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-bdc931e3-f4f0-4846-95f1-d533840720a0 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:05.946280 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c96cad06-8f3b-455f-83b8-025713e90707 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:05.946820 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c96cad06-8f3b-455f-83b8-025713e90707 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:05.947617 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c96cad06-8f3b-455f-83b8-025713e90707 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:05.949661 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c96cad06-8f3b-455f-83b8-025713e90707 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:06.153707 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-bdc931e3-f4f0-4846-95f1-d533840720a0 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:06.161617 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-c96cad06-8f3b-455f-83b8-025713e90707 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:06.161788 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-bdc931e3-f4f0-4846-95f1-d533840720a0 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1579 microversion: 2.1 time: 0.244395 Oct 28 09:55:06.162272 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 445/872] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:55:05 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1579 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:06.172297 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-c96cad06-8f3b-455f-83b8-025713e90707 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:06.174310 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-c96cad06-8f3b-455f-83b8-025713e90707 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:06.175543 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-c96cad06-8f3b-455f-83b8-025713e90707 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1744 microversion: 2.20 time: 0.259899 Oct 28 09:55:06.176102 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 428/873] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:55:05 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1744 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:06.967251 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-84e70ce9-b479-4869-9a46-e10d780f2b08 tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] Action: 'create', calling method: .version_select at 0x7fe121306f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1750408945"}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:07.185155 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-71f24cd8-fb26-494c-a725-65b0ded03f9a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:07.186012 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-71f24cd8-fb26-494c-a725-65b0ded03f9a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:55:07.193089 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-71f24cd8-fb26-494c-a725-65b0ded03f9a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:07.193478 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-71f24cd8-fb26-494c-a725-65b0ded03f9a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:07.194990 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-71f24cd8-fb26-494c-a725-65b0ded03f9a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:07.195436 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-71f24cd8-fb26-494c-a725-65b0ded03f9a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:07.371968 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-71f24cd8-fb26-494c-a725-65b0ded03f9a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:07.380557 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-71f24cd8-fb26-494c-a725-65b0ded03f9a tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1566 microversion: 2.1 time: 0.199528 Oct 28 09:55:07.381961 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 429/874] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:55:07 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1566 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:07.385512 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-01bfa324-ca57-4739-93c6-a18c3b0647e9 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:07.386141 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-01bfa324-ca57-4739-93c6-a18c3b0647e9 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:55:07.393202 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-01bfa324-ca57-4739-93c6-a18c3b0647e9 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:07.393651 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-01bfa324-ca57-4739-93c6-a18c3b0647e9 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:07.394430 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-01bfa324-ca57-4739-93c6-a18c3b0647e9 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:07.394866 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-01bfa324-ca57-4739-93c6-a18c3b0647e9 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:07.549309 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-01bfa324-ca57-4739-93c6-a18c3b0647e9 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:07.557420 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-01bfa324-ca57-4739-93c6-a18c3b0647e9 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:07.558909 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-01bfa324-ca57-4739-93c6-a18c3b0647e9 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:07.560128 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-01bfa324-ca57-4739-93c6-a18c3b0647e9 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1726 microversion: 2.20 time: 0.177984 Oct 28 09:55:07.566501 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 430/875] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:55:07 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1726 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:07.862678 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-84e70ce9-b479-4869-9a46-e10d780f2b08 tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] 10.222.0.104 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.012044 Oct 28 09:55:07.862678 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 446/876] 10.222.0.104 () {60 vars in 1159 bytes} [Thu Oct 28 09:55:06 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 1013 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Oct 28 09:55:07.862956 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-e95caebf-651e-4dfe-a959-32fa1d32249b tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] Calling method '.version_select at 0x7fe121c67c10>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:07.909511 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-e95caebf-651e-4dfe-a959-32fa1d32249b tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] 10.222.0.104 "GET /compute/v2.1/os-volumes/ddc16339-fb53-422c-ac98-41a12a1ba0ff" status: 200 len: 345 microversion: 2.1 time: 0.053624 Oct 28 09:55:07.914298 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 431/877] 10.222.0.104 () {58 vars in 1249 bytes} [Thu Oct 28 09:55:07 2021] GET /compute/v2.1/os-volumes/ddc16339-fb53-422c-ac98-41a12a1ba0ff => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:08.594550 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-684c49a7-7add-488d-af60-7aca371e1a71 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:08.605748 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-684c49a7-7add-488d-af60-7aca371e1a71 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:55:08.605748 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-684c49a7-7add-488d-af60-7aca371e1a71 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:08.605748 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-684c49a7-7add-488d-af60-7aca371e1a71 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:08.605748 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-684c49a7-7add-488d-af60-7aca371e1a71 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:08.606422 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-684c49a7-7add-488d-af60-7aca371e1a71 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:08.743806 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-684c49a7-7add-488d-af60-7aca371e1a71 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:08.765923 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-684c49a7-7add-488d-af60-7aca371e1a71 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:08.765923 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-684c49a7-7add-488d-af60-7aca371e1a71 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:08.765923 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-684c49a7-7add-488d-af60-7aca371e1a71 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1726 microversion: 2.20 time: 0.172755 Oct 28 09:55:08.766374 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 447/878] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:55:08 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1726 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:08.793998 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-5de55fdb-d297-4d43-a2eb-8878c409b5ae req-d70b4655-9082-4193-91a1-a2169c390616 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f18b00b-bb81-40c2-96fc-aeb3627b6028", "name": "network-vif-unplugged", "status": "completed", "tag": "15410dad-2493-48fa-8bb6-cbde6b1a0ab5"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:08.798424 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:55:08.798424 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:55:08.806380 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-5de55fdb-d297-4d43-a2eb-8878c409b5ae req-d70b4655-9082-4193-91a1-a2169c390616 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:08.806724 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-5de55fdb-d297-4d43-a2eb-8878c409b5ae req-d70b4655-9082-4193-91a1-a2169c390616 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:08.818291 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-5de55fdb-d297-4d43-a2eb-8878c409b5ae req-d70b4655-9082-4193-91a1-a2169c390616 service nova] Creating event network-vif-unplugged:15410dad-2493-48fa-8bb6-cbde6b1a0ab5 for instance 4f18b00b-bb81-40c2-96fc-aeb3627b6028 on hv-cinder-81571 Oct 28 09:55:08.830382 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-5de55fdb-d297-4d43-a2eb-8878c409b5ae req-d70b4655-9082-4193-91a1-a2169c390616 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033397 Oct 28 09:55:08.830382 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 432/879] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:55:08 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:08.927433 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-23b044a3-36b1-4e2f-bec8-801f717f33f6 tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] Calling method '.version_select at 0x7fe121306700>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:09.001912 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-23b044a3-36b1-4e2f-bec8-801f717f33f6 tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] 10.222.0.104 "GET /compute/v2.1/os-volumes/ddc16339-fb53-422c-ac98-41a12a1ba0ff" status: 200 len: 346 microversion: 2.1 time: 0.070754 Oct 28 09:55:09.001912 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 448/880] 10.222.0.104 () {58 vars in 1249 bytes} [Thu Oct 28 09:55:08 2021] GET /compute/v2.1/os-volumes/ddc16339-fb53-422c-ac98-41a12a1ba0ff => generated 346 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:09.006834 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-916edf44-57f6-4b23-a3d3-0fe17bd281d8 tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] Action: 'create', calling method: .version_select at 0x7fe121ca6670>, body: {"snapshot": {"volume_id": "ddc16339-fb53-422c-ac98-41a12a1ba0ff", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1653473961"}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:09.558756 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-916edf44-57f6-4b23-a3d3-0fe17bd281d8 tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] 10.222.0.104 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.555835 Oct 28 09:55:09.559398 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 433/881] 10.222.0.104 () {60 vars in 1166 bytes} [Thu Oct 28 09:55:09 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:55:09.573209 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-2a15ff7e-2fc9-4b6d-ac5e-7928aa8f3b66 tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] Calling method '.version_select at 0x7fe121335700>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:09.607932 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-2a15ff7e-2fc9-4b6d-ac5e-7928aa8f3b66 tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] 10.222.0.104 "GET /compute/v2.1/os-snapshots/318081da-f57c-465d-ae3c-671c4939591d" status: 200 len: 287 microversion: 2.1 time: 0.035789 Oct 28 09:55:09.607932 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 449/882] 10.222.0.104 () {58 vars in 1255 bytes} [Thu Oct 28 09:55:09 2021] GET /compute/v2.1/os-snapshots/318081da-f57c-465d-ae3c-671c4939591d => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:09.616434 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-a64b8a41-6d58-4705-8c85-d26caea33220 tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] Calling method '.version_select at 0x7fe121c65700>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:09.650210 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-a64b8a41-6d58-4705-8c85-d26caea33220 tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] 10.222.0.104 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.037456 Oct 28 09:55:09.650822 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 434/883] 10.222.0.104 () {58 vars in 1144 bytes} [Thu Oct 28 09:55:09 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:09.663056 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-9a8e8d34-2495-4f6b-925f-5709d966d47e tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] Calling method '.version_select at 0x7fe1212c0280>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:09.698219 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-9a8e8d34-2495-4f6b-925f-5709d966d47e tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] 10.222.0.104 "GET /compute/v2.1/os-snapshots/318081da-f57c-465d-ae3c-671c4939591d" status: 200 len: 287 microversion: 2.1 time: 0.038751 Oct 28 09:55:09.698786 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 450/884] 10.222.0.104 () {58 vars in 1255 bytes} [Thu Oct 28 09:55:09 2021] GET /compute/v2.1/os-snapshots/318081da-f57c-465d-ae3c-671c4939591d => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:09.780996 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-7a91d1e8-7478-4be4-bf26-1750bee9dd2d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:09.782120 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-7a91d1e8-7478-4be4-bf26-1750bee9dd2d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:55:09.789502 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7a91d1e8-7478-4be4-bf26-1750bee9dd2d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:09.796794 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7a91d1e8-7478-4be4-bf26-1750bee9dd2d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:09.796794 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7a91d1e8-7478-4be4-bf26-1750bee9dd2d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:09.796794 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7a91d1e8-7478-4be4-bf26-1750bee9dd2d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:09.931969 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-7a91d1e8-7478-4be4-bf26-1750bee9dd2d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:09.940934 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-7a91d1e8-7478-4be4-bf26-1750bee9dd2d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:09.942555 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-7a91d1e8-7478-4be4-bf26-1750bee9dd2d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:09.943717 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-7a91d1e8-7478-4be4-bf26-1750bee9dd2d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1729 microversion: 2.20 time: 0.168227 Oct 28 09:55:09.944286 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 435/885] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:55:09 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:09.961214 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-af6107ef-6da3-4c52-8b35-7eb523973b05 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97fb22e4-08ee-4583-b394-b70703861bf4"}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:09.964783 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-af6107ef-6da3-4c52-8b35-7eb523973b05 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:55:09.969637 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-af6107ef-6da3-4c52-8b35-7eb523973b05 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:09.970071 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-af6107ef-6da3-4c52-8b35-7eb523973b05 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:09.970872 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-af6107ef-6da3-4c52-8b35-7eb523973b05 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:09.971279 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-af6107ef-6da3-4c52-8b35-7eb523973b05 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:10.710392 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-df6dd155-280f-4bb7-94f7-1727cbe0d40e tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] Calling method '.version_select at 0x7fe121ca6310>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:10.742704 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-df6dd155-280f-4bb7-94f7-1727cbe0d40e tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] 10.222.0.104 "GET /compute/v2.1/os-snapshots/318081da-f57c-465d-ae3c-671c4939591d" status: 200 len: 287 microversion: 2.1 time: 0.035828 Oct 28 09:55:10.743279 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 436/886] 10.222.0.104 () {58 vars in 1255 bytes} [Thu Oct 28 09:55:10 2021] GET /compute/v2.1/os-snapshots/318081da-f57c-465d-ae3c-671c4939591d => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:55:11.144204 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-af6107ef-6da3-4c52-8b35-7eb523973b05 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.186725 Oct 28 09:55:11.144885 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 451/887] 10.222.0.104 () {62 vars in 1368 bytes} [Thu Oct 28 09:55:09 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/os-volume_attachments => generated 188 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:55:11.265034 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-4d93cdc5-7c29-4aa0-a6ed-37598197ad1e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:11.265579 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-4d93cdc5-7c29-4aa0-a6ed-37598197ad1e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:55:11.271747 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4d93cdc5-7c29-4aa0-a6ed-37598197ad1e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:11.272191 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4d93cdc5-7c29-4aa0-a6ed-37598197ad1e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:11.272990 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4d93cdc5-7c29-4aa0-a6ed-37598197ad1e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:11.273465 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4d93cdc5-7c29-4aa0-a6ed-37598197ad1e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:11.755119 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-af6b8882-36c7-40c5-bb1b-b579238b9765 tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] Calling method '.version_select at 0x7fe1212c0e50>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:11.784171 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-af6b8882-36c7-40c5-bb1b-b579238b9765 tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] 10.222.0.104 "GET /compute/v2.1/os-snapshots/318081da-f57c-465d-ae3c-671c4939591d" status: 200 len: 287 microversion: 2.1 time: 0.032969 Oct 28 09:55:11.784766 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 452/888] 10.222.0.104 () {58 vars in 1255 bytes} [Thu Oct 28 09:55:11 2021] GET /compute/v2.1/os-snapshots/318081da-f57c-465d-ae3c-671c4939591d => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:55:12.795859 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-6bd54a78-b4dd-4f13-a2ea-a6efd01fa3a2 tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] Calling method '.version_select at 0x7fe12133b8b0>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:12.826644 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-6bd54a78-b4dd-4f13-a2ea-a6efd01fa3a2 tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] 10.222.0.104 "GET /compute/v2.1/os-snapshots/318081da-f57c-465d-ae3c-671c4939591d" status: 200 len: 287 microversion: 2.1 time: 0.034253 Oct 28 09:55:12.827251 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 453/889] 10.222.0.104 () {58 vars in 1255 bytes} [Thu Oct 28 09:55:12 2021] GET /compute/v2.1/os-snapshots/318081da-f57c-465d-ae3c-671c4939591d => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:55:12.995268 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-4d93cdc5-7c29-4aa0-a6ed-37598197ad1e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "DELETE /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/os-volume_attachments/97fb22e4-08ee-4583-b394-b70703861bf4" status: 202 len: 0 microversion: 2.20 time: 1.734557 Oct 28 09:55:12.996035 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 437/890] 10.222.0.104 () {60 vars in 1461 bytes} [Thu Oct 28 09:55:11 2021] DELETE /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/os-volume_attachments/97fb22e4-08ee-4583-b394-b70703861bf4 => generated 0 bytes in 1736 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:55:13.050245 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-7fd269dc-d2ac-4356-b57c-ae4b30a5943a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:13.050850 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-7fd269dc-d2ac-4356-b57c-ae4b30a5943a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:55:13.056793 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7fd269dc-d2ac-4356-b57c-ae4b30a5943a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:13.063541 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7fd269dc-d2ac-4356-b57c-ae4b30a5943a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:13.063541 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7fd269dc-d2ac-4356-b57c-ae4b30a5943a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:13.063541 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7fd269dc-d2ac-4356-b57c-ae4b30a5943a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:13.289337 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-7fd269dc-d2ac-4356-b57c-ae4b30a5943a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action" status: 202 len: 0 microversion: 2.20 time: 0.242740 Oct 28 09:55:13.289937 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 454/891] 10.222.0.104 () {62 vars in 1323 bytes} [Thu Oct 28 09:55:13 2021] POST /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 28 09:55:13.298737 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-d3f691a7-7204-4fb9-aa23-0007c6bd0c88 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:13.299411 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-d3f691a7-7204-4fb9-aa23-0007c6bd0c88 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:55:13.305745 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d3f691a7-7204-4fb9-aa23-0007c6bd0c88 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:13.306461 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d3f691a7-7204-4fb9-aa23-0007c6bd0c88 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:13.307002 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d3f691a7-7204-4fb9-aa23-0007c6bd0c88 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:13.307425 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d3f691a7-7204-4fb9-aa23-0007c6bd0c88 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:13.441004 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-d3f691a7-7204-4fb9-aa23-0007c6bd0c88 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:13.443062 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-d3f691a7-7204-4fb9-aa23-0007c6bd0c88 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:13.444558 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-d3f691a7-7204-4fb9-aa23-0007c6bd0c88 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:13.445748 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-d3f691a7-7204-4fb9-aa23-0007c6bd0c88 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1677 microversion: 2.20 time: 0.151553 Oct 28 09:55:13.446331 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 438/892] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:55:13 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:13.838810 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-6fb19bbb-0ffd-4cd9-a28a-b3c5279c3580 tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] Calling method '.version_select at 0x7fe1212ccf70>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:13.879536 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-6fb19bbb-0ffd-4cd9-a28a-b3c5279c3580 tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] 10.222.0.104 "GET /compute/v2.1/os-snapshots/318081da-f57c-465d-ae3c-671c4939591d" status: 200 len: 288 microversion: 2.1 time: 0.044843 Oct 28 09:55:13.880186 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 455/893] 10.222.0.104 () {58 vars in 1255 bytes} [Thu Oct 28 09:55:13 2021] GET /compute/v2.1/os-snapshots/318081da-f57c-465d-ae3c-671c4939591d => generated 288 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:13.891830 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-a53174d1-df3e-49a6-97f0-258b89fa04ed tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] Calling method '.version_select at 0x7fe121c4d1f0>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:14.172005 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-a53174d1-df3e-49a6-97f0-258b89fa04ed tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] 10.222.0.104 "DELETE /compute/v2.1/os-snapshots/318081da-f57c-465d-ae3c-671c4939591d" status: 202 len: 0 microversion: 2.1 time: 0.285016 Oct 28 09:55:14.172779 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 439/894] 10.222.0.104 () {58 vars in 1258 bytes} [Thu Oct 28 09:55:13 2021] DELETE /compute/v2.1/os-snapshots/318081da-f57c-465d-ae3c-671c4939591d => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:55:14.182089 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-da35d2ef-ce97-4d8e-b52c-971e45ddcbe0 tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] Calling method '.version_select at 0x7fe1212ee4c0>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:14.213122 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-da35d2ef-ce97-4d8e-b52c-971e45ddcbe0 tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] 10.222.0.104 "GET /compute/v2.1/os-snapshots/318081da-f57c-465d-ae3c-671c4939591d" status: 200 len: 287 microversion: 2.1 time: 0.034701 Oct 28 09:55:14.213700 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 456/895] 10.222.0.104 () {58 vars in 1255 bytes} [Thu Oct 28 09:55:14 2021] GET /compute/v2.1/os-snapshots/318081da-f57c-465d-ae3c-671c4939591d => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:14.470257 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-c33e1b1f-23c5-47c0-9911-e4694d32cd51 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:14.471512 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-c33e1b1f-23c5-47c0-9911-e4694d32cd51 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:55:14.479589 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c33e1b1f-23c5-47c0-9911-e4694d32cd51 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:14.480026 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c33e1b1f-23c5-47c0-9911-e4694d32cd51 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:14.480857 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c33e1b1f-23c5-47c0-9911-e4694d32cd51 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:14.481280 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c33e1b1f-23c5-47c0-9911-e4694d32cd51 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:14.614085 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-c33e1b1f-23c5-47c0-9911-e4694d32cd51 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:14.623391 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-c33e1b1f-23c5-47c0-9911-e4694d32cd51 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:14.624909 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-c33e1b1f-23c5-47c0-9911-e4694d32cd51 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:14.626069 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-c33e1b1f-23c5-47c0-9911-e4694d32cd51 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1677 microversion: 2.20 time: 0.164307 Oct 28 09:55:14.626924 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 440/896] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:55:14 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:55:15.226192 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-4ff419b9-8ecc-4523-bf11-f3315350bc6c tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] Calling method '.version_select at 0x7fe12132a3a0>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:15.254960 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.wsgi [None req-4ff419b9-8ecc-4523-bf11-f3315350bc6c tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] HTTP exception thrown: Snapshot 318081da-f57c-465d-ae3c-671c4939591d could not be found. Oct 28 09:55:15.255555 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-4ff419b9-8ecc-4523-bf11-f3315350bc6c tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] Returning 404 to user: Snapshot 318081da-f57c-465d-ae3c-671c4939591d could not be found. {{(pid=123069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:55:15.256487 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-4ff419b9-8ecc-4523-bf11-f3315350bc6c tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] 10.222.0.104 "GET /compute/v2.1/os-snapshots/318081da-f57c-465d-ae3c-671c4939591d" status: 404 len: 111 microversion: 2.1 time: 0.034533 Oct 28 09:55:15.257079 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 457/897] 10.222.0.104 () {58 vars in 1255 bytes} [Thu Oct 28 09:55:15 2021] GET /compute/v2.1/os-snapshots/318081da-f57c-465d-ae3c-671c4939591d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:55:15.266017 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-b1766501-92c9-448f-88e7-a472b3616fbe tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] Calling method '.version_select at 0x7fe121c4a550>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:15.520324 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-b1766501-92c9-448f-88e7-a472b3616fbe tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] 10.222.0.104 "DELETE /compute/v2.1/os-volumes/ddc16339-fb53-422c-ac98-41a12a1ba0ff" status: 202 len: 0 microversion: 2.1 time: 0.258464 Oct 28 09:55:15.521237 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 441/898] 10.222.0.104 () {58 vars in 1252 bytes} [Thu Oct 28 09:55:15 2021] DELETE /compute/v2.1/os-volumes/ddc16339-fb53-422c-ac98-41a12a1ba0ff => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:55:15.532670 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-c15861dd-dc18-4ba5-9c82-f354cebbfd69 tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] Calling method '.version_select at 0x7fe1212ec280>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:15.584288 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-c15861dd-dc18-4ba5-9c82-f354cebbfd69 tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] 10.222.0.104 "GET /compute/v2.1/os-volumes/ddc16339-fb53-422c-ac98-41a12a1ba0ff" status: 200 len: 345 microversion: 2.1 time: 0.056233 Oct 28 09:55:15.584910 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 458/899] 10.222.0.104 () {58 vars in 1249 bytes} [Thu Oct 28 09:55:15 2021] GET /compute/v2.1/os-volumes/ddc16339-fb53-422c-ac98-41a12a1ba0ff => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:55:15.645449 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-f15ca4e6-3621-4fa6-a6d4-cf6087168d3e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:15.645983 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-f15ca4e6-3621-4fa6-a6d4-cf6087168d3e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:55:15.652330 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f15ca4e6-3621-4fa6-a6d4-cf6087168d3e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:15.652843 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f15ca4e6-3621-4fa6-a6d4-cf6087168d3e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:15.653618 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f15ca4e6-3621-4fa6-a6d4-cf6087168d3e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:15.654663 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f15ca4e6-3621-4fa6-a6d4-cf6087168d3e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:15.789400 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-f15ca4e6-3621-4fa6-a6d4-cf6087168d3e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:15.799422 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-f15ca4e6-3621-4fa6-a6d4-cf6087168d3e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:15.801207 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-f15ca4e6-3621-4fa6-a6d4-cf6087168d3e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:15.802451 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-f15ca4e6-3621-4fa6-a6d4-cf6087168d3e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1735 microversion: 2.20 time: 0.160998 Oct 28 09:55:15.803017 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 442/900] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:55:15 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:16.597453 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-5535ce4a-42c3-49f0-bf86-2cb8ddd7a6e6 tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] Calling method '.version_select at 0x7fe121335ca0>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:16.626871 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.wsgi [None req-5535ce4a-42c3-49f0-bf86-2cb8ddd7a6e6 tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] HTTP exception thrown: Volume ddc16339-fb53-422c-ac98-41a12a1ba0ff could not be found. Oct 28 09:55:16.627493 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-5535ce4a-42c3-49f0-bf86-2cb8ddd7a6e6 tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] Returning 404 to user: Volume ddc16339-fb53-422c-ac98-41a12a1ba0ff could not be found. {{(pid=123069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:55:16.628281 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-5535ce4a-42c3-49f0-bf86-2cb8ddd7a6e6 tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] 10.222.0.104 "GET /compute/v2.1/os-volumes/ddc16339-fb53-422c-ac98-41a12a1ba0ff" status: 404 len: 109 microversion: 2.1 time: 0.035213 Oct 28 09:55:16.628855 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 459/901] 10.222.0.104 () {58 vars in 1249 bytes} [Thu Oct 28 09:55:16 2021] GET /compute/v2.1/os-volumes/ddc16339-fb53-422c-ac98-41a12a1ba0ff => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:55:16.640676 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-d034cc3f-1b09-4c83-9e01-c8a46e6b70fb tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] Calling method '.version_select at 0x7fe121c4dd30>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:16.671361 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.wsgi [None req-d034cc3f-1b09-4c83-9e01-c8a46e6b70fb tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] HTTP exception thrown: Volume ddc16339-fb53-422c-ac98-41a12a1ba0ff could not be found. Oct 28 09:55:16.672606 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-d034cc3f-1b09-4c83-9e01-c8a46e6b70fb tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] Returning 404 to user: Volume ddc16339-fb53-422c-ac98-41a12a1ba0ff could not be found. {{(pid=123068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:55:16.672816 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-d034cc3f-1b09-4c83-9e01-c8a46e6b70fb tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] 10.222.0.104 "DELETE /compute/v2.1/os-volumes/ddc16339-fb53-422c-ac98-41a12a1ba0ff" status: 404 len: 109 microversion: 2.1 time: 0.037538 Oct 28 09:55:16.673363 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 443/902] 10.222.0.104 () {58 vars in 1252 bytes} [Thu Oct 28 09:55:16 2021] DELETE /compute/v2.1/os-volumes/ddc16339-fb53-422c-ac98-41a12a1ba0ff => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:55:16.681559 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-a47ccf7a-0ba4-4d32-89a7-0ec181b7ab1b tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] Calling method '.version_select at 0x7fe1212ec040>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:16.710810 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.wsgi [None req-a47ccf7a-0ba4-4d32-89a7-0ec181b7ab1b tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] HTTP exception thrown: Volume ddc16339-fb53-422c-ac98-41a12a1ba0ff could not be found. Oct 28 09:55:16.711401 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-a47ccf7a-0ba4-4d32-89a7-0ec181b7ab1b tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] Returning 404 to user: Volume ddc16339-fb53-422c-ac98-41a12a1ba0ff could not be found. {{(pid=123069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:55:16.712386 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-a47ccf7a-0ba4-4d32-89a7-0ec181b7ab1b tempest-VolumesSnapshotsTestJSON-1582985082 tempest-VolumesSnapshotsTestJSON-1582985082-project] 10.222.0.104 "GET /compute/v2.1/os-volumes/ddc16339-fb53-422c-ac98-41a12a1ba0ff" status: 404 len: 109 microversion: 2.1 time: 0.034830 Oct 28 09:55:16.713011 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 460/903] 10.222.0.104 () {58 vars in 1249 bytes} [Thu Oct 28 09:55:16 2021] GET /compute/v2.1/os-volumes/ddc16339-fb53-422c-ac98-41a12a1ba0ff => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:55:16.824198 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-f88545f5-62c2-4595-9177-775428c66191 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:16.824837 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-f88545f5-62c2-4595-9177-775428c66191 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:55:16.833430 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f88545f5-62c2-4595-9177-775428c66191 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:16.833996 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f88545f5-62c2-4595-9177-775428c66191 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:16.834809 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f88545f5-62c2-4595-9177-775428c66191 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:16.835259 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f88545f5-62c2-4595-9177-775428c66191 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:16.978433 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-f88545f5-62c2-4595-9177-775428c66191 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:16.994679 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-f88545f5-62c2-4595-9177-775428c66191 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:16.999402 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-f88545f5-62c2-4595-9177-775428c66191 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:17.002898 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-f88545f5-62c2-4595-9177-775428c66191 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1735 microversion: 2.20 time: 0.181767 Oct 28 09:55:17.004037 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 444/904] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:55:16 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1735 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:18.022863 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-d89df95d-68e0-448f-a0c1-7f2a487069f3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:18.031425 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-d89df95d-68e0-448f-a0c1-7f2a487069f3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:55:18.047567 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d89df95d-68e0-448f-a0c1-7f2a487069f3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:18.047567 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d89df95d-68e0-448f-a0c1-7f2a487069f3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:18.047567 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d89df95d-68e0-448f-a0c1-7f2a487069f3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:18.047567 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d89df95d-68e0-448f-a0c1-7f2a487069f3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:18.192539 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-d89df95d-68e0-448f-a0c1-7f2a487069f3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:18.201638 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-d89df95d-68e0-448f-a0c1-7f2a487069f3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:18.203145 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-d89df95d-68e0-448f-a0c1-7f2a487069f3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:18.204311 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-d89df95d-68e0-448f-a0c1-7f2a487069f3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1735 microversion: 2.20 time: 0.185884 Oct 28 09:55:18.204899 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 461/905] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:55:18 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:19.223589 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-e0e1a70f-a160-45bf-80b2-5536a9ee787d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:19.224987 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-e0e1a70f-a160-45bf-80b2-5536a9ee787d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:55:19.234050 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e0e1a70f-a160-45bf-80b2-5536a9ee787d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:19.235122 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e0e1a70f-a160-45bf-80b2-5536a9ee787d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:19.236485 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e0e1a70f-a160-45bf-80b2-5536a9ee787d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:19.237608 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e0e1a70f-a160-45bf-80b2-5536a9ee787d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:19.385443 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-e0e1a70f-a160-45bf-80b2-5536a9ee787d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:19.394554 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-e0e1a70f-a160-45bf-80b2-5536a9ee787d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:19.395829 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-e0e1a70f-a160-45bf-80b2-5536a9ee787d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:19.397047 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-e0e1a70f-a160-45bf-80b2-5536a9ee787d tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1735 microversion: 2.20 time: 0.177363 Oct 28 09:55:19.397604 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 445/906] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:55:19 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:20.415142 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-5805b418-ef98-4a09-88c0-d3c4d7362297 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:20.415836 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-5805b418-ef98-4a09-88c0-d3c4d7362297 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:55:20.424751 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5805b418-ef98-4a09-88c0-d3c4d7362297 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:20.425198 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5805b418-ef98-4a09-88c0-d3c4d7362297 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:20.430925 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5805b418-ef98-4a09-88c0-d3c4d7362297 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:20.430925 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5805b418-ef98-4a09-88c0-d3c4d7362297 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:20.596047 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-5805b418-ef98-4a09-88c0-d3c4d7362297 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:20.604581 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-5805b418-ef98-4a09-88c0-d3c4d7362297 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:20.606114 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-5805b418-ef98-4a09-88c0-d3c4d7362297 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:20.608246 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-5805b418-ef98-4a09-88c0-d3c4d7362297 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1735 microversion: 2.20 time: 0.196460 Oct 28 09:55:20.608999 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 462/907] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:55:20 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1735 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:21.296846 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-9dbd7897-4f3e-4d4e-a057-8e311601a69f tempest-VolumesTestJSON-301297968 tempest-VolumesTestJSON-301297968-project] Calling method '.version_select at 0x7fe121c4d430>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:21.346938 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-9dbd7897-4f3e-4d4e-a057-8e311601a69f tempest-VolumesTestJSON-301297968 tempest-VolumesTestJSON-301297968-project] 10.222.0.104 "GET /compute/v2.1/os-volumes/1414c20c-9f1b-4c6b-a636-772bb7d7642d" status: 200 len: 350 microversion: 2.1 time: 0.053959 Oct 28 09:55:21.347607 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 446/908] 10.222.0.104 () {58 vars in 1249 bytes} [Thu Oct 28 09:55:21 2021] GET /compute/v2.1/os-volumes/1414c20c-9f1b-4c6b-a636-772bb7d7642d => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:55:21.627033 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-ba2fdca9-3efd-4207-8974-af798297877b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:21.627628 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-ba2fdca9-3efd-4207-8974-af798297877b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:55:21.634108 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ba2fdca9-3efd-4207-8974-af798297877b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:21.634546 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ba2fdca9-3efd-4207-8974-af798297877b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:21.635727 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ba2fdca9-3efd-4207-8974-af798297877b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:21.635727 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ba2fdca9-3efd-4207-8974-af798297877b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:21.780399 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-ba2fdca9-3efd-4207-8974-af798297877b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:21.788538 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-ba2fdca9-3efd-4207-8974-af798297877b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:21.790104 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-ba2fdca9-3efd-4207-8974-af798297877b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:21.794778 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-ba2fdca9-3efd-4207-8974-af798297877b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1735 microversion: 2.20 time: 0.168205 Oct 28 09:55:21.794778 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 463/909] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:55:21 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:22.810022 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-20f9ec7b-ac71-4ed8-a006-e19e1183a34a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:22.812675 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-20f9ec7b-ac71-4ed8-a006-e19e1183a34a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:55:22.818593 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-20f9ec7b-ac71-4ed8-a006-e19e1183a34a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:22.819045 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-20f9ec7b-ac71-4ed8-a006-e19e1183a34a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:22.819834 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-20f9ec7b-ac71-4ed8-a006-e19e1183a34a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:22.820272 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-20f9ec7b-ac71-4ed8-a006-e19e1183a34a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:22.956765 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-20f9ec7b-ac71-4ed8-a006-e19e1183a34a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:22.965020 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-20f9ec7b-ac71-4ed8-a006-e19e1183a34a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:22.967162 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-20f9ec7b-ac71-4ed8-a006-e19e1183a34a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:22.968352 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-20f9ec7b-ac71-4ed8-a006-e19e1183a34a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1735 microversion: 2.20 time: 0.162764 Oct 28 09:55:22.969354 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 447/910] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:55:22 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:23.021843 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-b94e75d4-f531-453b-b143-c2899760bffb tempest-VolumesTestJSON-301297968 tempest-VolumesTestJSON-301297968-project] Calling method '.version_select at 0x7fe1239e7940>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:23.072991 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-b94e75d4-f531-453b-b143-c2899760bffb tempest-VolumesTestJSON-301297968 tempest-VolumesTestJSON-301297968-project] 10.222.0.104 "GET /compute/v2.1/os-volumes/48cb9fc2-8a22-4ccd-a09f-ee8b2d983dbc" status: 200 len: 350 microversion: 2.1 time: 0.054715 Oct 28 09:55:23.077213 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 464/911] 10.222.0.104 () {58 vars in 1249 bytes} [Thu Oct 28 09:55:23 2021] GET /compute/v2.1/os-volumes/48cb9fc2-8a22-4ccd-a09f-ee8b2d983dbc => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:23.987175 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-bcac704a-ff63-4979-bd5d-d4cbac72df03 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:23.987798 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-bcac704a-ff63-4979-bd5d-d4cbac72df03 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:55:23.994407 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bcac704a-ff63-4979-bd5d-d4cbac72df03 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:23.994834 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bcac704a-ff63-4979-bd5d-d4cbac72df03 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:23.995596 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bcac704a-ff63-4979-bd5d-d4cbac72df03 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:23.996017 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bcac704a-ff63-4979-bd5d-d4cbac72df03 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:24.129837 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-bcac704a-ff63-4979-bd5d-d4cbac72df03 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:24.140840 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-bcac704a-ff63-4979-bd5d-d4cbac72df03 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:24.142608 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-bcac704a-ff63-4979-bd5d-d4cbac72df03 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:24.143821 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-bcac704a-ff63-4979-bd5d-d4cbac72df03 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1735 microversion: 2.20 time: 0.160334 Oct 28 09:55:24.144881 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 448/912] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:55:23 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:24.743886 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-942b82e2-5811-4e02-a7dd-d85e16c81994 tempest-VolumesTestJSON-301297968 tempest-VolumesTestJSON-301297968-project] Calling method '.version_select at 0x7fe12142dd30>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:24.796239 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-942b82e2-5811-4e02-a7dd-d85e16c81994 tempest-VolumesTestJSON-301297968 tempest-VolumesTestJSON-301297968-project] 10.222.0.104 "GET /compute/v2.1/os-volumes/4ae4f3ee-e10f-4fd0-87f6-108c631434bd" status: 200 len: 350 microversion: 2.1 time: 0.056441 Oct 28 09:55:24.796831 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 465/913] 10.222.0.104 () {58 vars in 1249 bytes} [Thu Oct 28 09:55:24 2021] GET /compute/v2.1/os-volumes/4ae4f3ee-e10f-4fd0-87f6-108c631434bd => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:24.808079 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-72f5a226-2488-4e6b-8821-7e0ff524a664 tempest-VolumesTestJSON-301297968 tempest-VolumesTestJSON-301297968-project] Calling method '.version_select at 0x7fe121c4dd30>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:24.892345 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-72f5a226-2488-4e6b-8821-7e0ff524a664 tempest-VolumesTestJSON-301297968 tempest-VolumesTestJSON-301297968-project] 10.222.0.104 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.088043 Oct 28 09:55:24.892982 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 449/914] 10.222.0.104 () {58 vars in 1138 bytes} [Thu Oct 28 09:55:24 2021] GET /compute/v2.1/os-volumes => generated 1033 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:24.906276 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-ffa8ecbd-b521-4e1b-9ab9-d949777c78b8 tempest-VolumesTestJSON-301297968 tempest-VolumesTestJSON-301297968-project] Calling method '.version_select at 0x7fe1212a7700>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:24.993917 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-ffa8ecbd-b521-4e1b-9ab9-d949777c78b8 tempest-VolumesTestJSON-301297968 tempest-VolumesTestJSON-301297968-project] 10.222.0.104 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.091896 Oct 28 09:55:24.994973 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 466/915] 10.222.0.104 () {58 vars in 1153 bytes} [Thu Oct 28 09:55:24 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:55:25.015676 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-b7324d38-80b6-45cb-a92a-fe944f1f2312 tempest-VolumesTestJSON-301297968 tempest-VolumesTestJSON-301297968-project] Calling method '.version_select at 0x7fe121c1edc0>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:25.108981 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-b7324d38-80b6-45cb-a92a-fe944f1f2312 tempest-VolumesTestJSON-301297968 tempest-VolumesTestJSON-301297968-project] 10.222.0.104 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.100049 Oct 28 09:55:25.109940 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 450/916] 10.222.0.104 () {58 vars in 1138 bytes} [Thu Oct 28 09:55:25 2021] GET /compute/v2.1/os-volumes => generated 1033 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:25.121300 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-40486f3e-39e8-4be4-a9c4-e05a4c46735b tempest-VolumesTestJSON-301297968 tempest-VolumesTestJSON-301297968-project] Calling method '.version_select at 0x7fe122038550>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:25.163767 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-ddca86e7-1994-4858-8c3e-0664ff5a1a0e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:25.164799 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-ddca86e7-1994-4858-8c3e-0664ff5a1a0e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:55:25.174484 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ddca86e7-1994-4858-8c3e-0664ff5a1a0e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:25.174922 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ddca86e7-1994-4858-8c3e-0664ff5a1a0e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:25.176218 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ddca86e7-1994-4858-8c3e-0664ff5a1a0e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:25.176820 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ddca86e7-1994-4858-8c3e-0664ff5a1a0e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:25.205398 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-40486f3e-39e8-4be4-a9c4-e05a4c46735b tempest-VolumesTestJSON-301297968 tempest-VolumesTestJSON-301297968-project] 10.222.0.104 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.087599 Oct 28 09:55:25.205968 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 467/917] 10.222.0.104 () {58 vars in 1171 bytes} [Thu Oct 28 09:55:25 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:55:25.218869 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-49272563-7341-4805-a8d7-90ec4cc9f71b tempest-VolumesTestJSON-301297968 tempest-VolumesTestJSON-301297968-project] Calling method '.version_select at 0x7fe1212c0af0>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:25.324247 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-49272563-7341-4805-a8d7-90ec4cc9f71b tempest-VolumesTestJSON-301297968 tempest-VolumesTestJSON-301297968-project] 10.222.0.104 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.109499 Oct 28 09:55:25.324884 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 468/918] 10.222.0.104 () {58 vars in 1174 bytes} [Thu Oct 28 09:55:25 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:55:25.337302 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-d8d3b1af-1d2a-4864-844e-0ee70eb24730 tempest-VolumesTestJSON-301297968 tempest-VolumesTestJSON-301297968-project] Calling method '.version_select at 0x7fe1212a7310>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:25.344421 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-ddca86e7-1994-4858-8c3e-0664ff5a1a0e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:25.356124 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-ddca86e7-1994-4858-8c3e-0664ff5a1a0e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:25.358531 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-ddca86e7-1994-4858-8c3e-0664ff5a1a0e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:25.359782 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-ddca86e7-1994-4858-8c3e-0664ff5a1a0e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1735 microversion: 2.20 time: 0.200570 Oct 28 09:55:25.360341 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 451/919] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:55:25 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1735 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:25.426654 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-d8d3b1af-1d2a-4864-844e-0ee70eb24730 tempest-VolumesTestJSON-301297968 tempest-VolumesTestJSON-301297968-project] 10.222.0.104 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.092877 Oct 28 09:55:25.427233 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 469/920] 10.222.0.104 () {58 vars in 1159 bytes} [Thu Oct 28 09:55:25 2021] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:25.441161 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-e68c2b98-de50-4ab7-bf8a-9fccddb848cf tempest-VolumesTestJSON-301297968 tempest-VolumesTestJSON-301297968-project] Calling method '.version_select at 0x7fe121ca68b0>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:25.536180 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-e68c2b98-de50-4ab7-bf8a-9fccddb848cf tempest-VolumesTestJSON-301297968 tempest-VolumesTestJSON-301297968-project] 10.222.0.104 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.101593 Oct 28 09:55:25.536776 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 452/921] 10.222.0.104 () {58 vars in 1192 bytes} [Thu Oct 28 09:55:25 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:25.549891 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-1eb6e55a-3351-466f-b1e0-f4ce7212c12d tempest-VolumesTestJSON-301297968 tempest-VolumesTestJSON-301297968-project] Calling method '.version_select at 0x7fe1212a71f0>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:25.634456 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-1eb6e55a-3351-466f-b1e0-f4ce7212c12d tempest-VolumesTestJSON-301297968 tempest-VolumesTestJSON-301297968-project] 10.222.0.104 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.089102 Oct 28 09:55:25.635054 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 470/922] 10.222.0.104 () {58 vars in 1159 bytes} [Thu Oct 28 09:55:25 2021] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:26.383460 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-d00ebe91-d3a3-45a5-9318-19d6761dd45c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:26.384596 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-d00ebe91-d3a3-45a5-9318-19d6761dd45c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:55:26.396743 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d00ebe91-d3a3-45a5-9318-19d6761dd45c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:26.397331 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d00ebe91-d3a3-45a5-9318-19d6761dd45c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:26.398449 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d00ebe91-d3a3-45a5-9318-19d6761dd45c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:26.398836 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d00ebe91-d3a3-45a5-9318-19d6761dd45c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:26.561955 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-d00ebe91-d3a3-45a5-9318-19d6761dd45c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:26.571095 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-d00ebe91-d3a3-45a5-9318-19d6761dd45c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:26.572717 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-d00ebe91-d3a3-45a5-9318-19d6761dd45c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:26.574641 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-d00ebe91-d3a3-45a5-9318-19d6761dd45c tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1735 microversion: 2.20 time: 0.198661 Oct 28 09:55:26.576706 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 453/923] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:55:26 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1735 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:27.594559 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-b8c3bfda-d35e-466a-999d-8974c82d3eb2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:27.595391 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-b8c3bfda-d35e-466a-999d-8974c82d3eb2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:55:27.601427 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b8c3bfda-d35e-466a-999d-8974c82d3eb2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:27.601866 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b8c3bfda-d35e-466a-999d-8974c82d3eb2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:27.602645 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b8c3bfda-d35e-466a-999d-8974c82d3eb2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:27.603708 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b8c3bfda-d35e-466a-999d-8974c82d3eb2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:27.734263 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-b8c3bfda-d35e-466a-999d-8974c82d3eb2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:27.742342 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-b8c3bfda-d35e-466a-999d-8974c82d3eb2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:27.744106 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-b8c3bfda-d35e-466a-999d-8974c82d3eb2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:27.745275 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-b8c3bfda-d35e-466a-999d-8974c82d3eb2 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1735 microversion: 2.20 time: 0.155656 Oct 28 09:55:27.745832 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 471/924] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:55:27 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:28.763907 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-bf636030-83ff-4ed6-bea5-d2a6f1b60f1f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:28.764594 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-bf636030-83ff-4ed6-bea5-d2a6f1b60f1f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:55:28.771015 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bf636030-83ff-4ed6-bea5-d2a6f1b60f1f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:28.775195 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bf636030-83ff-4ed6-bea5-d2a6f1b60f1f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:28.775195 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bf636030-83ff-4ed6-bea5-d2a6f1b60f1f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:28.775195 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bf636030-83ff-4ed6-bea5-d2a6f1b60f1f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:28.902762 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-bf636030-83ff-4ed6-bea5-d2a6f1b60f1f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:28.911549 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-bf636030-83ff-4ed6-bea5-d2a6f1b60f1f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:28.913096 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-bf636030-83ff-4ed6-bea5-d2a6f1b60f1f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:28.914248 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-bf636030-83ff-4ed6-bea5-d2a6f1b60f1f tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1735 microversion: 2.20 time: 0.154414 Oct 28 09:55:28.914811 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 454/925] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:55:28 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:29.933323 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-d16a4058-0feb-49ee-8dba-9c1c9f9c1d5a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:29.933913 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-d16a4058-0feb-49ee-8dba-9c1c9f9c1d5a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:55:29.941338 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d16a4058-0feb-49ee-8dba-9c1c9f9c1d5a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:29.941775 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d16a4058-0feb-49ee-8dba-9c1c9f9c1d5a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:29.942542 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d16a4058-0feb-49ee-8dba-9c1c9f9c1d5a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:29.942965 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d16a4058-0feb-49ee-8dba-9c1c9f9c1d5a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:30.072356 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-d16a4058-0feb-49ee-8dba-9c1c9f9c1d5a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:30.080806 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-d16a4058-0feb-49ee-8dba-9c1c9f9c1d5a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:30.082379 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-d16a4058-0feb-49ee-8dba-9c1c9f9c1d5a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:30.083534 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-d16a4058-0feb-49ee-8dba-9c1c9f9c1d5a tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1735 microversion: 2.20 time: 0.153959 Oct 28 09:55:30.084095 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 472/926] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:55:29 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:31.101516 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-2fde6808-aa8b-4d22-ba0d-7934bdec88a7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:31.102749 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-2fde6808-aa8b-4d22-ba0d-7934bdec88a7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:55:31.109427 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2fde6808-aa8b-4d22-ba0d-7934bdec88a7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:31.109875 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2fde6808-aa8b-4d22-ba0d-7934bdec88a7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:31.110663 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2fde6808-aa8b-4d22-ba0d-7934bdec88a7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:31.111110 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2fde6808-aa8b-4d22-ba0d-7934bdec88a7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:31.252375 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-2fde6808-aa8b-4d22-ba0d-7934bdec88a7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:31.260465 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-2fde6808-aa8b-4d22-ba0d-7934bdec88a7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:31.262054 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-2fde6808-aa8b-4d22-ba0d-7934bdec88a7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:31.263672 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-2fde6808-aa8b-4d22-ba0d-7934bdec88a7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1735 microversion: 2.20 time: 0.165778 Oct 28 09:55:31.264240 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 455/927] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:55:31 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:32.282054 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-9fd346bc-38ee-4ab7-b38b-93c8e7ec07f3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:32.282664 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-9fd346bc-38ee-4ab7-b38b-93c8e7ec07f3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:55:32.289098 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9fd346bc-38ee-4ab7-b38b-93c8e7ec07f3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:32.289533 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9fd346bc-38ee-4ab7-b38b-93c8e7ec07f3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:32.290366 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9fd346bc-38ee-4ab7-b38b-93c8e7ec07f3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:32.290818 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9fd346bc-38ee-4ab7-b38b-93c8e7ec07f3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:32.428297 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-9fd346bc-38ee-4ab7-b38b-93c8e7ec07f3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:32.436832 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-9fd346bc-38ee-4ab7-b38b-93c8e7ec07f3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:32.438316 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-9fd346bc-38ee-4ab7-b38b-93c8e7ec07f3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:32.439707 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-9fd346bc-38ee-4ab7-b38b-93c8e7ec07f3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1735 microversion: 2.20 time: 0.161671 Oct 28 09:55:32.440446 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 473/928] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:55:32 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:33.183568 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-5c4594a7-f16b-4082-aa7f-36c9e94e1dd3 req-449b1c1e-8297-4e45-babd-477c1e223e2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f18b00b-bb81-40c2-96fc-aeb3627b6028", "name": "network-vif-plugged", "status": "completed", "tag": "15410dad-2493-48fa-8bb6-cbde6b1a0ab5"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:33.187072 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:55:33.187072 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:55:33.196917 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-5c4594a7-f16b-4082-aa7f-36c9e94e1dd3 req-449b1c1e-8297-4e45-babd-477c1e223e2b service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:33.199959 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-5c4594a7-f16b-4082-aa7f-36c9e94e1dd3 req-449b1c1e-8297-4e45-babd-477c1e223e2b service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:33.211864 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-5c4594a7-f16b-4082-aa7f-36c9e94e1dd3 req-449b1c1e-8297-4e45-babd-477c1e223e2b service nova] Creating event network-vif-plugged:15410dad-2493-48fa-8bb6-cbde6b1a0ab5 for instance 4f18b00b-bb81-40c2-96fc-aeb3627b6028 on hv-cinder-81571 Oct 28 09:55:33.217523 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-5c4594a7-f16b-4082-aa7f-36c9e94e1dd3 req-449b1c1e-8297-4e45-babd-477c1e223e2b service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038635 Oct 28 09:55:33.218142 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 456/929] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:55:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:55:33.457774 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-1c8448a1-dca0-4621-92e3-dab81d18f1b4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:33.462166 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-1c8448a1-dca0-4621-92e3-dab81d18f1b4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:55:33.464607 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1c8448a1-dca0-4621-92e3-dab81d18f1b4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:33.465082 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1c8448a1-dca0-4621-92e3-dab81d18f1b4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:33.465897 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1c8448a1-dca0-4621-92e3-dab81d18f1b4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:33.466314 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1c8448a1-dca0-4621-92e3-dab81d18f1b4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:33.602629 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-1c8448a1-dca0-4621-92e3-dab81d18f1b4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:33.612069 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-1c8448a1-dca0-4621-92e3-dab81d18f1b4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:33.613887 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-1c8448a1-dca0-4621-92e3-dab81d18f1b4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:33.615260 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-1c8448a1-dca0-4621-92e3-dab81d18f1b4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1735 microversion: 2.20 time: 0.161296 Oct 28 09:55:33.615980 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 474/930] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:55:33 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:34.635603 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-9f45f10f-4ebd-42fe-9b0c-a98fa03b215e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:34.636301 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-9f45f10f-4ebd-42fe-9b0c-a98fa03b215e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:55:34.643704 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9f45f10f-4ebd-42fe-9b0c-a98fa03b215e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:34.644278 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9f45f10f-4ebd-42fe-9b0c-a98fa03b215e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:34.645144 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9f45f10f-4ebd-42fe-9b0c-a98fa03b215e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:34.645354 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9f45f10f-4ebd-42fe-9b0c-a98fa03b215e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:34.779825 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-9f45f10f-4ebd-42fe-9b0c-a98fa03b215e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:34.788140 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-9f45f10f-4ebd-42fe-9b0c-a98fa03b215e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:34.789631 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-9f45f10f-4ebd-42fe-9b0c-a98fa03b215e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:34.790813 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-9f45f10f-4ebd-42fe-9b0c-a98fa03b215e tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1735 microversion: 2.20 time: 0.159888 Oct 28 09:55:34.791370 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 457/931] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:55:34 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:35.812686 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-5085a41d-58f2-44f0-a5d1-5c7b719497c4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:35.813316 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-5085a41d-58f2-44f0-a5d1-5c7b719497c4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:55:35.821050 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5085a41d-58f2-44f0-a5d1-5c7b719497c4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:35.821543 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5085a41d-58f2-44f0-a5d1-5c7b719497c4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:35.822411 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5085a41d-58f2-44f0-a5d1-5c7b719497c4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:35.822901 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5085a41d-58f2-44f0-a5d1-5c7b719497c4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:35.968225 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-5085a41d-58f2-44f0-a5d1-5c7b719497c4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:35.980819 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-5085a41d-58f2-44f0-a5d1-5c7b719497c4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:35.983392 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-5085a41d-58f2-44f0-a5d1-5c7b719497c4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:35.984574 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-5085a41d-58f2-44f0-a5d1-5c7b719497c4 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1735 microversion: 2.20 time: 0.177387 Oct 28 09:55:35.986040 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 475/932] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:55:35 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:37.003056 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-662bc9e9-020b-47e2-961f-658083c13ff7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:37.003658 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-662bc9e9-020b-47e2-961f-658083c13ff7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:55:37.010284 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-662bc9e9-020b-47e2-961f-658083c13ff7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:37.010703 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-662bc9e9-020b-47e2-961f-658083c13ff7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:37.011468 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-662bc9e9-020b-47e2-961f-658083c13ff7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:55:37.011891 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-662bc9e9-020b-47e2-961f-658083c13ff7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:55:37.133174 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-662bc9e9-020b-47e2-961f-658083c13ff7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:37.141436 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-662bc9e9-020b-47e2-961f-658083c13ff7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:37.143004 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-662bc9e9-020b-47e2-961f-658083c13ff7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:37.144215 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-662bc9e9-020b-47e2-961f-658083c13ff7 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1722 microversion: 2.20 time: 0.145088 Oct 28 09:55:37.144789 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 458/933] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:55:36 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1722 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:56:15.713418 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-2b3843b7-2fd1-4f0f-a2b6-4c4a2759c7fb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:15.714432 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-2b3843b7-2fd1-4f0f-a2b6-4c4a2759c7fb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:56:15.721520 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2b3843b7-2fd1-4f0f-a2b6-4c4a2759c7fb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:15.721959 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2b3843b7-2fd1-4f0f-a2b6-4c4a2759c7fb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:15.722801 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2b3843b7-2fd1-4f0f-a2b6-4c4a2759c7fb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:15.723234 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2b3843b7-2fd1-4f0f-a2b6-4c4a2759c7fb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:15.756831 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-2b3843b7-2fd1-4f0f-a2b6-4c4a2759c7fb tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047417 Oct 28 09:56:15.757415 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 476/934] 10.222.0.104 () {60 vars in 1347 bytes} [Thu Oct 28 09:56:15 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:15.816441 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-8bcb9ea1-d569-4bed-aff8-29921b5a9d2b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:15.817116 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-8bcb9ea1-d569-4bed-aff8-29921b5a9d2b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:56:15.823435 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8bcb9ea1-d569-4bed-aff8-29921b5a9d2b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:15.823875 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8bcb9ea1-d569-4bed-aff8-29921b5a9d2b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:15.824709 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8bcb9ea1-d569-4bed-aff8-29921b5a9d2b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:15.825282 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8bcb9ea1-d569-4bed-aff8-29921b5a9d2b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:15.853500 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-8bcb9ea1-d569-4bed-aff8-29921b5a9d2b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Going to try to terminate instance {{(pid=123068) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 09:56:16.244252 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-8bcb9ea1-d569-4bed-aff8-29921b5a9d2b tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "DELETE /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 204 len: 0 microversion: 2.20 time: 0.431422 Oct 28 09:56:16.245172 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 459/935] 10.222.0.104 () {60 vars in 1284 bytes} [Thu Oct 28 09:56:15 2021] DELETE /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 09:56:16.254434 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-d2b00a97-105c-4c43-a2f5-1c4edbafb5a5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:16.255076 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-d2b00a97-105c-4c43-a2f5-1c4edbafb5a5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:56:16.261355 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d2b00a97-105c-4c43-a2f5-1c4edbafb5a5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:16.261795 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d2b00a97-105c-4c43-a2f5-1c4edbafb5a5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:16.264100 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d2b00a97-105c-4c43-a2f5-1c4edbafb5a5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:16.264560 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d2b00a97-105c-4c43-a2f5-1c4edbafb5a5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:16.395884 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-d2b00a97-105c-4c43-a2f5-1c4edbafb5a5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:16.404705 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-d2b00a97-105c-4c43-a2f5-1c4edbafb5a5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:16.406274 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-d2b00a97-105c-4c43-a2f5-1c4edbafb5a5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:16.407497 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-d2b00a97-105c-4c43-a2f5-1c4edbafb5a5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1728 microversion: 2.20 time: 0.156929 Oct 28 09:56:16.408063 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 477/936] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:56:16 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:56:17.426976 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-c2d650b9-7ae0-440b-b5a3-887ee7973ba3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:17.427972 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-c2d650b9-7ae0-440b-b5a3-887ee7973ba3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:56:17.434935 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c2d650b9-7ae0-440b-b5a3-887ee7973ba3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:17.435374 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c2d650b9-7ae0-440b-b5a3-887ee7973ba3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:17.436154 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c2d650b9-7ae0-440b-b5a3-887ee7973ba3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:17.436573 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c2d650b9-7ae0-440b-b5a3-887ee7973ba3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:17.585818 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-c2d650b9-7ae0-440b-b5a3-887ee7973ba3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:17.599191 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-c2d650b9-7ae0-440b-b5a3-887ee7973ba3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:17.601571 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-c2d650b9-7ae0-440b-b5a3-887ee7973ba3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:17.602813 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-c2d650b9-7ae0-440b-b5a3-887ee7973ba3 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1728 microversion: 2.20 time: 0.180209 Oct 28 09:56:17.603415 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 460/937] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:56:17 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1728 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:56:18.625170 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-5985670d-a3a5-4e9b-9eac-3d357ccbedc5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:18.626353 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-5985670d-a3a5-4e9b-9eac-3d357ccbedc5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:56:18.634607 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5985670d-a3a5-4e9b-9eac-3d357ccbedc5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:18.638648 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5985670d-a3a5-4e9b-9eac-3d357ccbedc5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:18.638648 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5985670d-a3a5-4e9b-9eac-3d357ccbedc5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:18.638648 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5985670d-a3a5-4e9b-9eac-3d357ccbedc5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:18.735944 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-5985670d-a3a5-4e9b-9eac-3d357ccbedc5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:18.747188 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-5985670d-a3a5-4e9b-9eac-3d357ccbedc5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:18.749524 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-5985670d-a3a5-4e9b-9eac-3d357ccbedc5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dc1f105c9714526a2a0fb7b51d93102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137c34c5941c4c86801a0e6b8b5c2f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:18.750961 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-5985670d-a3a5-4e9b-9eac-3d357ccbedc5 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 200 len: 1661 microversion: 2.20 time: 0.130235 Oct 28 09:56:18.752151 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 478/938] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:56:18 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 1661 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:56:18.808320 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-515cef6c-0a07-445d-8916-0740f279bbc0 req-17490b04-9c28-4f4c-8825-97db5708ecc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f18b00b-bb81-40c2-96fc-aeb3627b6028", "name": "network-vif-deleted", "tag": "15410dad-2493-48fa-8bb6-cbde6b1a0ab5"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:18.817304 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:56:18.817304 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:56:18.833351 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-515cef6c-0a07-445d-8916-0740f279bbc0 req-17490b04-9c28-4f4c-8825-97db5708ecc2 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:18.834609 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-515cef6c-0a07-445d-8916-0740f279bbc0 req-17490b04-9c28-4f4c-8825-97db5708ecc2 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:18.854985 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-515cef6c-0a07-445d-8916-0740f279bbc0 req-17490b04-9c28-4f4c-8825-97db5708ecc2 service nova] Creating event network-vif-deleted:15410dad-2493-48fa-8bb6-cbde6b1a0ab5 for instance 4f18b00b-bb81-40c2-96fc-aeb3627b6028 on hv-cinder-81571 Oct 28 09:56:18.865764 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-515cef6c-0a07-445d-8916-0740f279bbc0 req-17490b04-9c28-4f4c-8825-97db5708ecc2 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064008 Oct 28 09:56:18.866769 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 461/939] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:56:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:19.782792 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-15460d3e-e1ce-472c-be03-5f0b89c2e757 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:19.783409 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-15460d3e-e1ce-472c-be03-5f0b89c2e757 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:56:19.790487 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-15460d3e-e1ce-472c-be03-5f0b89c2e757 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:19.791218 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-15460d3e-e1ce-472c-be03-5f0b89c2e757 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:19.792155 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-15460d3e-e1ce-472c-be03-5f0b89c2e757 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:19.792626 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-15460d3e-e1ce-472c-be03-5f0b89c2e757 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:19.812053 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.wsgi [None req-15460d3e-e1ce-472c-be03-5f0b89c2e757 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] HTTP exception thrown: Instance 4f18b00b-bb81-40c2-96fc-aeb3627b6028 could not be found. Oct 28 09:56:19.812674 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-15460d3e-e1ce-472c-be03-5f0b89c2e757 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Returning 404 to user: Instance 4f18b00b-bb81-40c2-96fc-aeb3627b6028 could not be found. {{(pid=123069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:56:19.813514 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-15460d3e-e1ce-472c-be03-5f0b89c2e757 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 404 len: 111 microversion: 2.20 time: 0.035774 Oct 28 09:56:19.814084 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 479/940] 10.222.0.104 () {60 vars in 1281 bytes} [Thu Oct 28 09:56:19 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 09:56:19.823096 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-7e51fd25-e953-456f-8c8c-c4715a70bdfa tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '.version_select at 0x7fe121ccb0d0>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:19.919731 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-7e51fd25-e953-456f-8c8c-c4715a70bdfa tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1278874634" status: 204 len: 0 microversion: 2.20 time: 0.099725 Oct 28 09:56:19.921142 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 462/941] 10.222.0.104 () {60 vars in 1266 bytes} [Thu Oct 28 09:56:19 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1278874634 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 09:56:22.182230 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-4ed9727c-fd43-436a-a7cf-003437d15b13 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:22.194956 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-4ed9727c-fd43-436a-a7cf-003437d15b13 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:56:22.194956 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4ed9727c-fd43-436a-a7cf-003437d15b13 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:22.194956 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4ed9727c-fd43-436a-a7cf-003437d15b13 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:22.195482 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4ed9727c-fd43-436a-a7cf-003437d15b13 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:22.196131 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4ed9727c-fd43-436a-a7cf-003437d15b13 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:22.381361 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.wsgi [None req-4ed9727c-fd43-436a-a7cf-003437d15b13 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] HTTP exception thrown: Instance 4f18b00b-bb81-40c2-96fc-aeb3627b6028 could not be found. Oct 28 09:56:22.382360 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-4ed9727c-fd43-436a-a7cf-003437d15b13 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Returning 404 to user: Instance 4f18b00b-bb81-40c2-96fc-aeb3627b6028 could not be found. {{(pid=123069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:56:22.383884 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-4ed9727c-fd43-436a-a7cf-003437d15b13 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "DELETE /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 404 len: 111 microversion: 2.1 time: 0.208116 Oct 28 09:56:22.384745 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 480/942] 10.222.0.104 () {58 vars in 1243 bytes} [Thu Oct 28 09:56:22 2021] DELETE /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 111 bytes in 210 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:56:22.398654 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-735b57a5-95b3-486b-bbbd-35af33213edf tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:22.399606 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-735b57a5-95b3-486b-bbbd-35af33213edf tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: 4f18b00b-bb81-40c2-96fc-aeb3627b6028] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:56:22.410356 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-735b57a5-95b3-486b-bbbd-35af33213edf tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:22.410799 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-735b57a5-95b3-486b-bbbd-35af33213edf tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:22.411599 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-735b57a5-95b3-486b-bbbd-35af33213edf tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:22.412034 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-735b57a5-95b3-486b-bbbd-35af33213edf tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:22.430448 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.wsgi [None req-735b57a5-95b3-486b-bbbd-35af33213edf tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] HTTP exception thrown: Instance 4f18b00b-bb81-40c2-96fc-aeb3627b6028 could not be found. Oct 28 09:56:22.431148 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-735b57a5-95b3-486b-bbbd-35af33213edf tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Returning 404 to user: Instance 4f18b00b-bb81-40c2-96fc-aeb3627b6028 could not be found. {{(pid=123068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:56:22.432158 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-735b57a5-95b3-486b-bbbd-35af33213edf tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028" status: 404 len: 111 microversion: 2.1 time: 0.040096 Oct 28 09:56:22.433071 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 463/943] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:56:22 2021] GET /compute/v2.1/servers/4f18b00b-bb81-40c2-96fc-aeb3627b6028 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 09:56:23.774557 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-c767fb42-4e67-45ba-ab90-2478f1c51566 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:23.776071 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-c767fb42-4e67-45ba-ab90-2478f1c51566 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:56:23.784503 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c767fb42-4e67-45ba-ab90-2478f1c51566 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:23.784985 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c767fb42-4e67-45ba-ab90-2478f1c51566 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:23.786008 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c767fb42-4e67-45ba-ab90-2478f1c51566 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:23.786435 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c767fb42-4e67-45ba-ab90-2478f1c51566 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:23.801358 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.wsgi [None req-c767fb42-4e67-45ba-ab90-2478f1c51566 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] HTTP exception thrown: Instance b49b31e1-36d8-4096-a5fc-b2d46ef922eb could not be found. Oct 28 09:56:23.802101 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-c767fb42-4e67-45ba-ab90-2478f1c51566 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Returning 404 to user: Instance b49b31e1-36d8-4096-a5fc-b2d46ef922eb could not be found. {{(pid=123069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:56:23.802929 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-c767fb42-4e67-45ba-ab90-2478f1c51566 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "DELETE /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 404 len: 111 microversion: 2.1 time: 0.033829 Oct 28 09:56:23.803494 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 481/944] 10.222.0.104 () {58 vars in 1243 bytes} [Thu Oct 28 09:56:23 2021] DELETE /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:56:23.812143 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-d1c4b6be-b2c6-4a5d-a284-470cbc8c3565 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:23.812983 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-d1c4b6be-b2c6-4a5d-a284-470cbc8c3565 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] [instance: b49b31e1-36d8-4096-a5fc-b2d46ef922eb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:56:23.819623 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d1c4b6be-b2c6-4a5d-a284-470cbc8c3565 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:23.820066 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d1c4b6be-b2c6-4a5d-a284-470cbc8c3565 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:23.820899 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d1c4b6be-b2c6-4a5d-a284-470cbc8c3565 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:23.821433 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d1c4b6be-b2c6-4a5d-a284-470cbc8c3565 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:23.836454 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.wsgi [None req-d1c4b6be-b2c6-4a5d-a284-470cbc8c3565 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] HTTP exception thrown: Instance b49b31e1-36d8-4096-a5fc-b2d46ef922eb could not be found. Oct 28 09:56:23.837397 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-d1c4b6be-b2c6-4a5d-a284-470cbc8c3565 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] Returning 404 to user: Instance b49b31e1-36d8-4096-a5fc-b2d46ef922eb could not be found. {{(pid=123068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:56:23.838905 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-d1c4b6be-b2c6-4a5d-a284-470cbc8c3565 tempest-AttachVolumeShelveTestJSON-533859878 tempest-AttachVolumeShelveTestJSON-533859878-project] 10.222.0.104 "GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb" status: 404 len: 111 microversion: 2.1 time: 0.030481 Oct 28 09:56:23.843209 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 464/945] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:56:23 2021] GET /compute/v2.1/servers/b49b31e1-36d8-4096-a5fc-b2d46ef922eb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:56:24.782263 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-93a9c785-7cdb-4dc1-8bc9-0b5442dc32ee tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:24.783614 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-93a9c785-7cdb-4dc1-8bc9-0b5442dc32ee tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:56:24.791747 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-93a9c785-7cdb-4dc1-8bc9-0b5442dc32ee tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:24.792806 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-93a9c785-7cdb-4dc1-8bc9-0b5442dc32ee tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:24.794456 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-93a9c785-7cdb-4dc1-8bc9-0b5442dc32ee tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:24.794901 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-93a9c785-7cdb-4dc1-8bc9-0b5442dc32ee tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:24.829592 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-93a9c785-7cdb-4dc1-8bc9-0b5442dc32ee tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Going to try to terminate instance {{(pid=123069) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 09:56:25.216202 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-442869ef-e6aa-412a-9da2-638226f48e49 req-ec27235f-d779-4fac-a837-533627fce838 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a28831e5-4c0c-4dd9-bf92-ccf43a500b27", "tag": "94cbd2b9-09d8-4c85-ab69-0e95ad1404ee"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:25.220440 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:56:25.220440 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:56:25.241823 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-442869ef-e6aa-412a-9da2-638226f48e49 req-ec27235f-d779-4fac-a837-533627fce838 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:25.242731 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-442869ef-e6aa-412a-9da2-638226f48e49 req-ec27235f-d779-4fac-a837-533627fce838 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:25.252332 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-93a9c785-7cdb-4dc1-8bc9-0b5442dc32ee tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "DELETE /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 204 len: 0 microversion: 2.1 time: 0.474398 Oct 28 09:56:25.257095 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 482/946] 10.222.0.104 () {58 vars in 1243 bytes} [Thu Oct 28 09:56:24 2021] DELETE /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:56:25.263311 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-76ffa137-7076-4cef-994e-3e082f819b89 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:25.264493 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-76ffa137-7076-4cef-994e-3e082f819b89 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:56:25.271808 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-442869ef-e6aa-412a-9da2-638226f48e49 req-ec27235f-d779-4fac-a837-533627fce838 service nova] Creating event network-changed:94cbd2b9-09d8-4c85-ab69-0e95ad1404ee for instance a28831e5-4c0c-4dd9-bf92-ccf43a500b27 on hv-cinder-81571 Oct 28 09:56:25.272893 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-76ffa137-7076-4cef-994e-3e082f819b89 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:25.273344 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-76ffa137-7076-4cef-994e-3e082f819b89 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:25.274132 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-76ffa137-7076-4cef-994e-3e082f819b89 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:25.274741 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-76ffa137-7076-4cef-994e-3e082f819b89 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:25.282945 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-442869ef-e6aa-412a-9da2-638226f48e49 req-ec27235f-d779-4fac-a837-533627fce838 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.485507 Oct 28 09:56:25.284814 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 465/947] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:56:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:25.468474 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-76ffa137-7076-4cef-994e-3e082f819b89 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:25.477989 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-76ffa137-7076-4cef-994e-3e082f819b89 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1572 microversion: 2.1 time: 0.219538 Oct 28 09:56:25.479093 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 483/948] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:56:25 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1572 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:26.513721 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-d4853ac5-588f-4df3-b1c0-dd714716f556 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:26.517026 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-d4853ac5-588f-4df3-b1c0-dd714716f556 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:56:26.529566 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d4853ac5-588f-4df3-b1c0-dd714716f556 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:26.530650 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d4853ac5-588f-4df3-b1c0-dd714716f556 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:26.532487 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d4853ac5-588f-4df3-b1c0-dd714716f556 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:26.533389 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d4853ac5-588f-4df3-b1c0-dd714716f556 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:26.787577 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-d4853ac5-588f-4df3-b1c0-dd714716f556 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:26.808270 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-d4853ac5-588f-4df3-b1c0-dd714716f556 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1572 microversion: 2.1 time: 0.306790 Oct 28 09:56:26.817513 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 466/949] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:56:26 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1572 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:27.588505 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [req-3a567240-78bc-4bec-979a-094a7950ddaa req-e09c53fb-d907-4769-8de1-ba5f47537302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a28831e5-4c0c-4dd9-bf92-ccf43a500b27", "name": "network-vif-deleted", "tag": "94cbd2b9-09d8-4c85-ab69-0e95ad1404ee"}]} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:27.591319 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:56:27.591319 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 09:56:27.604286 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-3a567240-78bc-4bec-979a-094a7950ddaa req-e09c53fb-d907-4769-8de1-ba5f47537302 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:27.606631 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-3a567240-78bc-4bec-979a-094a7950ddaa req-e09c53fb-d907-4769-8de1-ba5f47537302 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:27.626113 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.compute.server_external_events [req-3a567240-78bc-4bec-979a-094a7950ddaa req-e09c53fb-d907-4769-8de1-ba5f47537302 service nova] Creating event network-vif-deleted:94cbd2b9-09d8-4c85-ab69-0e95ad1404ee for instance a28831e5-4c0c-4dd9-bf92-ccf43a500b27 on hv-cinder-81571 Oct 28 09:56:27.632048 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [req-3a567240-78bc-4bec-979a-094a7950ddaa req-e09c53fb-d907-4769-8de1-ba5f47537302 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047387 Oct 28 09:56:27.632674 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 484/950] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:56:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:27.837954 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-f2357b94-6356-49c2-b52e-b9adf07dce10 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:27.838804 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-f2357b94-6356-49c2-b52e-b9adf07dce10 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:56:27.855033 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f2357b94-6356-49c2-b52e-b9adf07dce10 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:27.856537 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f2357b94-6356-49c2-b52e-b9adf07dce10 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:27.857825 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f2357b94-6356-49c2-b52e-b9adf07dce10 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:27.858450 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f2357b94-6356-49c2-b52e-b9adf07dce10 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:28.084173 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-f2357b94-6356-49c2-b52e-b9adf07dce10 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:28.095268 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-f2357b94-6356-49c2-b52e-b9adf07dce10 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1222 microversion: 2.1 time: 0.257645 Oct 28 09:56:28.096300 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 467/951] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:56:27 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1222 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:29.115601 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-d1d10327-6c91-46ce-9789-c86132de38f3 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:29.117343 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-d1d10327-6c91-46ce-9789-c86132de38f3 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:56:29.125670 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d1d10327-6c91-46ce-9789-c86132de38f3 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:29.129608 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d1d10327-6c91-46ce-9789-c86132de38f3 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:29.129608 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d1d10327-6c91-46ce-9789-c86132de38f3 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:29.129608 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d1d10327-6c91-46ce-9789-c86132de38f3 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:29.173605 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d1d10327-6c91-46ce-9789-c86132de38f3 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:29.174350 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d1d10327-6c91-46ce-9789-c86132de38f3 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:29.174999 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.objects.instance [None req-d1d10327-6c91-46ce-9789-c86132de38f3 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lazy-loading 'fault' on Instance uuid a28831e5-4c0c-4dd9-bf92-ccf43a500b27 {{(pid=123069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 09:56:29.233190 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-d1d10327-6c91-46ce-9789-c86132de38f3 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9859c6302ddc418da07047bf02603788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8171734427fe4b4bb14d52d4d336a76b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:29.244090 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-d1d10327-6c91-46ce-9789-c86132de38f3 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 200 len: 1227 microversion: 2.1 time: 0.133794 Oct 28 09:56:29.255254 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 485/952] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:56:29 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 1227 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:30.262760 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-470ea945-a601-4ff1-93cf-35dbeb960155 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:30.263460 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-470ea945-a601-4ff1-93cf-35dbeb960155 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] [instance: a28831e5-4c0c-4dd9-bf92-ccf43a500b27] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:56:30.269629 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-470ea945-a601-4ff1-93cf-35dbeb960155 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:30.270065 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-470ea945-a601-4ff1-93cf-35dbeb960155 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:30.270825 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-470ea945-a601-4ff1-93cf-35dbeb960155 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:30.271249 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-470ea945-a601-4ff1-93cf-35dbeb960155 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:30.285671 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.wsgi [None req-470ea945-a601-4ff1-93cf-35dbeb960155 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] HTTP exception thrown: Instance a28831e5-4c0c-4dd9-bf92-ccf43a500b27 could not be found. Oct 28 09:56:30.286259 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-470ea945-a601-4ff1-93cf-35dbeb960155 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Returning 404 to user: Instance a28831e5-4c0c-4dd9-bf92-ccf43a500b27 could not be found. {{(pid=123068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:56:30.287118 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-470ea945-a601-4ff1-93cf-35dbeb960155 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27" status: 404 len: 111 microversion: 2.1 time: 0.028112 Oct 28 09:56:30.287654 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 468/953] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:56:30 2021] GET /compute/v2.1/servers/a28831e5-4c0c-4dd9-bf92-ccf43a500b27 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 09:56:30.618654 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-3a6f2ee0-c5a9-4862-89be-b55b93320508 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] Calling method '.version_select at 0x7fe1212cc9d0>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:30.773420 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-3a6f2ee0-c5a9-4862-89be-b55b93320508 tempest-TestShelveInstance-2013799725 tempest-TestShelveInstance-2013799725-project] 10.222.0.104 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-359364649" status: 202 len: 0 microversion: 2.1 time: 0.158453 Oct 28 09:56:30.778486 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 486/954] 10.222.0.104 () {58 vars in 1255 bytes} [Thu Oct 28 09:56:30 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-359364649 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:56:34.073729 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-53546967-7f02-4b17-9e96-092bea167214 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1979899098", "imageRef": "623b30fc-1d92-46d9-b556-b9b963f3d76c", "flavorRef": "452", "networks": [{"uuid": "138f56a9-ba13-417d-bda4-3ae273e68e25"}]}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:34.142923 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.network.neutron [None req-53546967-7f02-4b17-9e96-092bea167214 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] validate_networks() for [('138f56a9-ba13-417d-bda4-3ae273e68e25', None, None, None, None, None)] {{(pid=123068) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 09:56:34.814717 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-53546967-7f02-4b17-9e96-092bea167214 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Flavor limits 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:56:34.815121 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-53546967-7f02-4b17-9e96-092bea167214 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Image limits 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:56:34.815583 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-53546967-7f02-4b17-9e96-092bea167214 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Flavor pref 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:56:34.816171 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-53546967-7f02-4b17-9e96-092bea167214 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Image pref 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:56:34.816876 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-53546967-7f02-4b17-9e96-092bea167214 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:56:34.827409 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-53546967-7f02-4b17-9e96-092bea167214 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:34.828385 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-53546967-7f02-4b17-9e96-092bea167214 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:34.829613 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-53546967-7f02-4b17-9e96-092bea167214 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:34.830219 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-53546967-7f02-4b17-9e96-092bea167214 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:34.859802 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.quota [None req-53546967-7f02-4b17-9e96-092bea167214 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Getting quotas for project b70e48e454564b15803319964d0e32bc. Resources: {'ram', 'cores', 'instances'} {{(pid=123068) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 09:56:34.876840 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.quota [None req-53546967-7f02-4b17-9e96-092bea167214 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Getting quotas for user fc5490f30a0348bd899c522049f6a528 and project b70e48e454564b15803319964d0e32bc. Resources: {'ram', 'cores', 'instances'} {{(pid=123068) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 09:56:34.904512 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-53546967-7f02-4b17-9e96-092bea167214 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Going to run 1 instances... {{(pid=123068) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 09:56:34.907259 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-53546967-7f02-4b17-9e96-092bea167214 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 02a6163e-083b-464d-8650-77d3e421ffa6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='623b30fc-1d92-46d9-b556-b9b963f3d76c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 09:56:35.050118 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-53546967-7f02-4b17-9e96-092bea167214 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.143645 Oct 28 09:56:35.050762 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 469/955] 10.222.0.104 () {60 vars in 1151 bytes} [Thu Oct 28 09:56:33 2021] POST /compute/v2.1/servers => generated 382 bytes in 1145 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 28 09:56:35.062512 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-6c60080b-6fb5-4e1b-bafd-bd1eaf1c317a tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:35.063819 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-6c60080b-6fb5-4e1b-bafd-bd1eaf1c317a tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 02a6163e-083b-464d-8650-77d3e421ffa6] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:56:35.121792 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-6c60080b-6fb5-4e1b-bafd-bd1eaf1c317a tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:35.130256 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-6c60080b-6fb5-4e1b-bafd-bd1eaf1c317a tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6" status: 200 len: 1222 microversion: 2.1 time: 0.073205 Oct 28 09:56:35.135609 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 487/956] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:56:35 2021] GET /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6 => generated 1222 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:36.151570 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-1e5e81d6-4144-4a01-939d-531fcf8af080 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:36.152918 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-1e5e81d6-4144-4a01-939d-531fcf8af080 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 02a6163e-083b-464d-8650-77d3e421ffa6] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:56:36.162383 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1e5e81d6-4144-4a01-939d-531fcf8af080 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:36.162833 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1e5e81d6-4144-4a01-939d-531fcf8af080 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:36.163659 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1e5e81d6-4144-4a01-939d-531fcf8af080 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:36.164092 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1e5e81d6-4144-4a01-939d-531fcf8af080 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:36.237731 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-1e5e81d6-4144-4a01-939d-531fcf8af080 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:36.245587 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-1e5e81d6-4144-4a01-939d-531fcf8af080 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6" status: 200 len: 1226 microversion: 2.1 time: 0.097827 Oct 28 09:56:36.246802 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 470/957] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:56:36 2021] GET /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:37.264995 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-75be92e5-50f4-4ea2-bc9e-a4a4e9e48b4d tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:37.266180 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-75be92e5-50f4-4ea2-bc9e-a4a4e9e48b4d tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 02a6163e-083b-464d-8650-77d3e421ffa6] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:56:37.273595 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-75be92e5-50f4-4ea2-bc9e-a4a4e9e48b4d tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:37.274132 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-75be92e5-50f4-4ea2-bc9e-a4a4e9e48b4d tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:37.274983 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-75be92e5-50f4-4ea2-bc9e-a4a4e9e48b4d tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:37.275872 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-75be92e5-50f4-4ea2-bc9e-a4a4e9e48b4d tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:37.375006 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-75be92e5-50f4-4ea2-bc9e-a4a4e9e48b4d tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:37.383336 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-75be92e5-50f4-4ea2-bc9e-a4a4e9e48b4d tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6" status: 200 len: 1274 microversion: 2.1 time: 0.123794 Oct 28 09:56:37.386086 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 488/958] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:56:37 2021] GET /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6 => generated 1274 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:38.399597 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-2e0c2a79-fdc1-45c6-b5da-beced3314506 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:38.400198 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-2e0c2a79-fdc1-45c6-b5da-beced3314506 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 02a6163e-083b-464d-8650-77d3e421ffa6] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:56:38.407595 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2e0c2a79-fdc1-45c6-b5da-beced3314506 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:38.407956 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2e0c2a79-fdc1-45c6-b5da-beced3314506 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:38.408759 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2e0c2a79-fdc1-45c6-b5da-beced3314506 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:38.409193 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2e0c2a79-fdc1-45c6-b5da-beced3314506 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:38.478669 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-2e0c2a79-fdc1-45c6-b5da-beced3314506 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:38.487765 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-2e0c2a79-fdc1-45c6-b5da-beced3314506 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6" status: 200 len: 1280 microversion: 2.1 time: 0.091819 Oct 28 09:56:38.488343 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 471/959] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:56:38 2021] GET /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6 => generated 1280 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:39.505174 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-5d28c3fe-a4eb-4298-b8d7-f9ab67887ec5 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:39.505878 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-5d28c3fe-a4eb-4298-b8d7-f9ab67887ec5 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 02a6163e-083b-464d-8650-77d3e421ffa6] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:56:39.512548 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5d28c3fe-a4eb-4298-b8d7-f9ab67887ec5 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:39.513390 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5d28c3fe-a4eb-4298-b8d7-f9ab67887ec5 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:39.514816 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5d28c3fe-a4eb-4298-b8d7-f9ab67887ec5 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:39.515590 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5d28c3fe-a4eb-4298-b8d7-f9ab67887ec5 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:39.661829 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-5d28c3fe-a4eb-4298-b8d7-f9ab67887ec5 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:39.671016 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-5d28c3fe-a4eb-4298-b8d7-f9ab67887ec5 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6" status: 200 len: 1322 microversion: 2.1 time: 0.169629 Oct 28 09:56:39.675491 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 489/960] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:56:39 2021] GET /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:40.220213 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-5eb95d3f-468c-41c0-8bcd-b7f272b15a4d req-a4ff1ce3-507d-45cf-b5b0-18b4e1e4e2ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02a6163e-083b-464d-8650-77d3e421ffa6", "tag": "07e48416-de5b-46f9-b34f-60662f138c23"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:40.221842 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:56:40.221842 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:56:40.230077 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-5eb95d3f-468c-41c0-8bcd-b7f272b15a4d req-a4ff1ce3-507d-45cf-b5b0-18b4e1e4e2ea service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:40.230750 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-5eb95d3f-468c-41c0-8bcd-b7f272b15a4d req-a4ff1ce3-507d-45cf-b5b0-18b4e1e4e2ea service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:40.243165 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-5eb95d3f-468c-41c0-8bcd-b7f272b15a4d req-a4ff1ce3-507d-45cf-b5b0-18b4e1e4e2ea service nova] Creating event network-changed:07e48416-de5b-46f9-b34f-60662f138c23 for instance 02a6163e-083b-464d-8650-77d3e421ffa6 on hv-cinder-81571 Oct 28 09:56:40.248014 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-5eb95d3f-468c-41c0-8bcd-b7f272b15a4d req-a4ff1ce3-507d-45cf-b5b0-18b4e1e4e2ea service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032989 Oct 28 09:56:40.248967 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 472/961] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:56:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:40.689847 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-47f06a97-58c8-44a9-81e3-38309eb6d4f6 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:40.697572 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-47f06a97-58c8-44a9-81e3-38309eb6d4f6 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 02a6163e-083b-464d-8650-77d3e421ffa6] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:56:40.707478 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-47f06a97-58c8-44a9-81e3-38309eb6d4f6 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:40.707932 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-47f06a97-58c8-44a9-81e3-38309eb6d4f6 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:40.708772 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-47f06a97-58c8-44a9-81e3-38309eb6d4f6 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:40.709201 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-47f06a97-58c8-44a9-81e3-38309eb6d4f6 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:40.848940 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-47f06a97-58c8-44a9-81e3-38309eb6d4f6 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:40.856565 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-47f06a97-58c8-44a9-81e3-38309eb6d4f6 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6" status: 200 len: 1322 microversion: 2.1 time: 0.170941 Oct 28 09:56:40.858254 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 490/962] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:56:40 2021] GET /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:41.876920 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-a251c77b-e39d-44cb-8854-ed2918671f91 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:41.877661 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-a251c77b-e39d-44cb-8854-ed2918671f91 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 02a6163e-083b-464d-8650-77d3e421ffa6] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:56:41.885046 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a251c77b-e39d-44cb-8854-ed2918671f91 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:41.885751 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a251c77b-e39d-44cb-8854-ed2918671f91 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:41.886841 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a251c77b-e39d-44cb-8854-ed2918671f91 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:41.887590 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a251c77b-e39d-44cb-8854-ed2918671f91 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:42.018806 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-a251c77b-e39d-44cb-8854-ed2918671f91 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:42.026440 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-a251c77b-e39d-44cb-8854-ed2918671f91 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6" status: 200 len: 1322 microversion: 2.1 time: 0.155515 Oct 28 09:56:42.027601 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 473/963] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:56:41 2021] GET /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:43.046329 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-40b460ae-6070-4df4-995f-63bc5cc67d33 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:43.046979 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-40b460ae-6070-4df4-995f-63bc5cc67d33 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 02a6163e-083b-464d-8650-77d3e421ffa6] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:56:43.053445 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-40b460ae-6070-4df4-995f-63bc5cc67d33 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:43.053899 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-40b460ae-6070-4df4-995f-63bc5cc67d33 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:43.054720 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-40b460ae-6070-4df4-995f-63bc5cc67d33 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:43.055144 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-40b460ae-6070-4df4-995f-63bc5cc67d33 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:43.209555 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-40b460ae-6070-4df4-995f-63bc5cc67d33 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:43.217237 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-40b460ae-6070-4df4-995f-63bc5cc67d33 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6" status: 200 len: 1322 microversion: 2.1 time: 0.177321 Oct 28 09:56:43.217896 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 491/964] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:56:43 2021] GET /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:44.234325 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-41b86069-37e5-47be-8824-e9e4251f7146 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:44.234947 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-41b86069-37e5-47be-8824-e9e4251f7146 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 02a6163e-083b-464d-8650-77d3e421ffa6] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:56:44.241167 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-41b86069-37e5-47be-8824-e9e4251f7146 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:44.241631 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-41b86069-37e5-47be-8824-e9e4251f7146 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:44.242423 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-41b86069-37e5-47be-8824-e9e4251f7146 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:44.242886 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-41b86069-37e5-47be-8824-e9e4251f7146 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:44.373656 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-41b86069-37e5-47be-8824-e9e4251f7146 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:44.381175 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-41b86069-37e5-47be-8824-e9e4251f7146 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6" status: 200 len: 1322 microversion: 2.1 time: 0.150894 Oct 28 09:56:44.381752 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 474/965] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:56:44 2021] GET /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:45.398983 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-68410a69-4a8d-4afa-81cc-1a24c0c78d2a tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:45.400409 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-68410a69-4a8d-4afa-81cc-1a24c0c78d2a tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 02a6163e-083b-464d-8650-77d3e421ffa6] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:56:45.407890 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-68410a69-4a8d-4afa-81cc-1a24c0c78d2a tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:45.408624 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-68410a69-4a8d-4afa-81cc-1a24c0c78d2a tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:45.409626 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-68410a69-4a8d-4afa-81cc-1a24c0c78d2a tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:45.410534 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-68410a69-4a8d-4afa-81cc-1a24c0c78d2a tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:45.594404 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-68410a69-4a8d-4afa-81cc-1a24c0c78d2a tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:45.603966 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-68410a69-4a8d-4afa-81cc-1a24c0c78d2a tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6" status: 200 len: 1322 microversion: 2.1 time: 0.208486 Oct 28 09:56:45.606179 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 492/966] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:56:45 2021] GET /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:45.670006 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-3987ca66-e7db-4093-ae68-42e22b70ad0d req-fa089247-d4c6-4129-8c6f-e411d9ed9695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02a6163e-083b-464d-8650-77d3e421ffa6", "name": "network-vif-plugged", "status": "completed", "tag": "07e48416-de5b-46f9-b34f-60662f138c23"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:45.670592 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:56:45.670592 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:56:45.680465 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-3987ca66-e7db-4093-ae68-42e22b70ad0d req-fa089247-d4c6-4129-8c6f-e411d9ed9695 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:45.681023 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-3987ca66-e7db-4093-ae68-42e22b70ad0d req-fa089247-d4c6-4129-8c6f-e411d9ed9695 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:45.694663 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-3987ca66-e7db-4093-ae68-42e22b70ad0d req-fa089247-d4c6-4129-8c6f-e411d9ed9695 service nova] Creating event network-vif-plugged:07e48416-de5b-46f9-b34f-60662f138c23 for instance 02a6163e-083b-464d-8650-77d3e421ffa6 on hv-cinder-81571 Oct 28 09:56:45.700973 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-3987ca66-e7db-4093-ae68-42e22b70ad0d req-fa089247-d4c6-4129-8c6f-e411d9ed9695 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037300 Oct 28 09:56:45.701569 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 475/967] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:56:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:46.622846 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-d4bf5ae2-2508-4173-aed6-b4677f8fda17 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:46.624023 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-d4bf5ae2-2508-4173-aed6-b4677f8fda17 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 02a6163e-083b-464d-8650-77d3e421ffa6] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:56:46.630894 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d4bf5ae2-2508-4173-aed6-b4677f8fda17 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:46.631431 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d4bf5ae2-2508-4173-aed6-b4677f8fda17 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:46.632318 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d4bf5ae2-2508-4173-aed6-b4677f8fda17 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:46.632918 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d4bf5ae2-2508-4173-aed6-b4677f8fda17 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:46.866193 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-d4bf5ae2-2508-4173-aed6-b4677f8fda17 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:46.877974 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-d4bf5ae2-2508-4173-aed6-b4677f8fda17 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6" status: 200 len: 1322 microversion: 2.1 time: 0.258946 Oct 28 09:56:46.889149 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 493/968] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:56:46 2021] GET /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6 => generated 1322 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:47.896837 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-9b83b852-077f-42d3-84c7-2417bd3e8974 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:47.897542 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-9b83b852-077f-42d3-84c7-2417bd3e8974 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 02a6163e-083b-464d-8650-77d3e421ffa6] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:56:47.904531 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9b83b852-077f-42d3-84c7-2417bd3e8974 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:47.905015 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9b83b852-077f-42d3-84c7-2417bd3e8974 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:47.905834 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9b83b852-077f-42d3-84c7-2417bd3e8974 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:47.906268 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9b83b852-077f-42d3-84c7-2417bd3e8974 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:48.044455 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-9b83b852-077f-42d3-84c7-2417bd3e8974 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:48.055299 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-9b83b852-077f-42d3-84c7-2417bd3e8974 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6" status: 200 len: 1513 microversion: 2.1 time: 0.162160 Oct 28 09:56:48.056199 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 476/969] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:56:47 2021] GET /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:50.138251 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-846caa1f-23e0-40e6-952b-714e03fff2c7 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c0c61e6-bc5a-4c61-a2b7-d9c4232511ec"}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:50.139365 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-846caa1f-23e0-40e6-952b-714e03fff2c7 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 02a6163e-083b-464d-8650-77d3e421ffa6] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:56:50.146227 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-846caa1f-23e0-40e6-952b-714e03fff2c7 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:50.146703 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-846caa1f-23e0-40e6-952b-714e03fff2c7 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:50.147617 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-846caa1f-23e0-40e6-952b-714e03fff2c7 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:50.147926 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-846caa1f-23e0-40e6-952b-714e03fff2c7 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:51.068588 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-846caa1f-23e0-40e6-952b-714e03fff2c7 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "POST /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.934635 Oct 28 09:56:51.069609 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 494/970] 10.222.0.104 () {60 vars in 1327 bytes} [Thu Oct 28 09:56:50 2021] POST /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6/os-volume_attachments => generated 194 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:56.219025 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-3fcefe3a-9e18-4540-be23-04fb1f74215f tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Action: 'create', calling method: .version_select at 0x7fe121c654c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-87968533"}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:56.238701 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.quota [None req-3fcefe3a-9e18-4540-be23-04fb1f74215f tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Getting quotas for project 8891d4ce726f4b84a18cbb3bce4e53c3. Resources: {'key_pairs'} {{(pid=123068) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 09:56:56.242862 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.quota [None req-3fcefe3a-9e18-4540-be23-04fb1f74215f tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Getting quotas for user c6c7a9975b554c30956dcd3d34b93a97 and project 8891d4ce726f4b84a18cbb3bce4e53c3. Resources: {'key_pairs'} {{(pid=123068) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 09:56:56.567244 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.quota [None req-3fcefe3a-9e18-4540-be23-04fb1f74215f tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Getting quotas for project 8891d4ce726f4b84a18cbb3bce4e53c3. Resources: {'key_pairs'} {{(pid=123068) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 09:56:56.567244 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.quota [None req-3fcefe3a-9e18-4540-be23-04fb1f74215f tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Getting quotas for user c6c7a9975b554c30956dcd3d34b93a97 and project 8891d4ce726f4b84a18cbb3bce4e53c3. Resources: {'key_pairs'} {{(pid=123068) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 09:56:56.581327 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-3fcefe3a-9e18-4540-be23-04fb1f74215f tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.568146 Oct 28 09:56:56.581929 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 477/971] 10.222.0.104 () {60 vars in 1162 bytes} [Thu Oct 28 09:56:56 2021] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:58.760076 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-837fa146-cc50-4005-b808-e5098af1ffac tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-113042496", "imageRef": "623b30fc-1d92-46d9-b556-b9b963f3d76c", "flavorRef": "452", "networks": [{"uuid": "138f56a9-ba13-417d-bda4-3ae273e68e25"}]}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:58.829254 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.network.neutron [None req-837fa146-cc50-4005-b808-e5098af1ffac tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] validate_networks() for [('138f56a9-ba13-417d-bda4-3ae273e68e25', None, None, None, None, None)] {{(pid=123069) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 09:56:59.422198 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-837fa146-cc50-4005-b808-e5098af1ffac tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Flavor limits 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:56:59.422619 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-837fa146-cc50-4005-b808-e5098af1ffac tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Image limits 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:56:59.423084 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-837fa146-cc50-4005-b808-e5098af1ffac tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Flavor pref 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:56:59.423478 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-837fa146-cc50-4005-b808-e5098af1ffac tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Image pref 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:56:59.423913 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-837fa146-cc50-4005-b808-e5098af1ffac tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:56:59.434049 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-837fa146-cc50-4005-b808-e5098af1ffac tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:59.434487 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-837fa146-cc50-4005-b808-e5098af1ffac tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:59.435281 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-837fa146-cc50-4005-b808-e5098af1ffac tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:56:59.435706 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-837fa146-cc50-4005-b808-e5098af1ffac tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:56:59.453434 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.quota [None req-837fa146-cc50-4005-b808-e5098af1ffac tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Getting quotas for project b70e48e454564b15803319964d0e32bc. Resources: {'ram', 'cores', 'instances'} {{(pid=123069) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 09:56:59.457487 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.quota [None req-837fa146-cc50-4005-b808-e5098af1ffac tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Getting quotas for user fc5490f30a0348bd899c522049f6a528 and project b70e48e454564b15803319964d0e32bc. Resources: {'ram', 'cores', 'instances'} {{(pid=123069) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 09:56:59.470001 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-837fa146-cc50-4005-b808-e5098af1ffac tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Going to run 1 instances... {{(pid=123069) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 09:56:59.473612 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-837fa146-cc50-4005-b808-e5098af1ffac tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 694199a8-e0fe-4c60-87ff-77409ae17040] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='623b30fc-1d92-46d9-b556-b9b963f3d76c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 09:56:59.760690 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-837fa146-cc50-4005-b808-e5098af1ffac tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.009480 Oct 28 09:56:59.762353 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 495/972] 10.222.0.104 () {60 vars in 1151 bytes} [Thu Oct 28 09:56:58 2021] POST /compute/v2.1/servers => generated 382 bytes in 1012 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 28 09:56:59.773086 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-738f2a6a-56a5-414c-aecf-948fafdc9b2c tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:59.773700 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-738f2a6a-56a5-414c-aecf-948fafdc9b2c tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 694199a8-e0fe-4c60-87ff-77409ae17040] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:56:59.858439 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-738f2a6a-56a5-414c-aecf-948fafdc9b2c tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:59.872128 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-738f2a6a-56a5-414c-aecf-948fafdc9b2c tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/694199a8-e0fe-4c60-87ff-77409ae17040" status: 200 len: 1221 microversion: 2.1 time: 0.103189 Oct 28 09:56:59.874286 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 478/973] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:56:59 2021] GET /compute/v2.1/servers/694199a8-e0fe-4c60-87ff-77409ae17040 => generated 1221 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:00.901568 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-e436cdb7-8023-474c-970e-6ca365099dd6 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:00.902465 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-e436cdb7-8023-474c-970e-6ca365099dd6 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 694199a8-e0fe-4c60-87ff-77409ae17040] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:00.910261 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e436cdb7-8023-474c-970e-6ca365099dd6 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:00.910742 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e436cdb7-8023-474c-970e-6ca365099dd6 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:00.911770 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e436cdb7-8023-474c-970e-6ca365099dd6 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:00.914624 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e436cdb7-8023-474c-970e-6ca365099dd6 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:00.983977 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-e436cdb7-8023-474c-970e-6ca365099dd6 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:00.995639 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-e436cdb7-8023-474c-970e-6ca365099dd6 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/694199a8-e0fe-4c60-87ff-77409ae17040" status: 200 len: 1225 microversion: 2.1 time: 0.094678 Oct 28 09:57:00.995639 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 496/974] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:00 2021] GET /compute/v2.1/servers/694199a8-e0fe-4c60-87ff-77409ae17040 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:02.010090 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-f1c1372d-4721-49d9-9d28-3e83f3ab8811 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:02.011220 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-f1c1372d-4721-49d9-9d28-3e83f3ab8811 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 694199a8-e0fe-4c60-87ff-77409ae17040] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:02.018021 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f1c1372d-4721-49d9-9d28-3e83f3ab8811 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:02.018461 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f1c1372d-4721-49d9-9d28-3e83f3ab8811 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:02.019270 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f1c1372d-4721-49d9-9d28-3e83f3ab8811 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:02.019708 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f1c1372d-4721-49d9-9d28-3e83f3ab8811 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:02.087674 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-f1c1372d-4721-49d9-9d28-3e83f3ab8811 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:02.096525 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-f1c1372d-4721-49d9-9d28-3e83f3ab8811 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/694199a8-e0fe-4c60-87ff-77409ae17040" status: 200 len: 1281 microversion: 2.1 time: 0.090276 Oct 28 09:57:02.097124 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 479/975] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:02 2021] GET /compute/v2.1/servers/694199a8-e0fe-4c60-87ff-77409ae17040 => generated 1281 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:03.114106 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-afa3d786-eb9c-49c8-8e19-056d2180a58b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:03.114691 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-afa3d786-eb9c-49c8-8e19-056d2180a58b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 694199a8-e0fe-4c60-87ff-77409ae17040] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:03.122788 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-afa3d786-eb9c-49c8-8e19-056d2180a58b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:03.122788 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-afa3d786-eb9c-49c8-8e19-056d2180a58b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:03.123162 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-afa3d786-eb9c-49c8-8e19-056d2180a58b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:03.123591 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-afa3d786-eb9c-49c8-8e19-056d2180a58b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:03.273534 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-afa3d786-eb9c-49c8-8e19-056d2180a58b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:03.282497 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-afa3d786-eb9c-49c8-8e19-056d2180a58b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/694199a8-e0fe-4c60-87ff-77409ae17040" status: 200 len: 1321 microversion: 2.1 time: 0.172148 Oct 28 09:57:03.283075 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 497/976] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:03 2021] GET /compute/v2.1/servers/694199a8-e0fe-4c60-87ff-77409ae17040 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:03.879149 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-5503d3e8-6e4c-4d8e-9b9c-02fb0ad153af req-c7a66c23-2c61-408d-a8c1-eda65f213afd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "694199a8-e0fe-4c60-87ff-77409ae17040", "tag": "a4980d72-c568-47e2-86cf-4feeb9e706c7"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:03.881244 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:57:03.881244 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:57:03.891075 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-5503d3e8-6e4c-4d8e-9b9c-02fb0ad153af req-c7a66c23-2c61-408d-a8c1-eda65f213afd service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:03.891516 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-5503d3e8-6e4c-4d8e-9b9c-02fb0ad153af req-c7a66c23-2c61-408d-a8c1-eda65f213afd service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:03.903976 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-5503d3e8-6e4c-4d8e-9b9c-02fb0ad153af req-c7a66c23-2c61-408d-a8c1-eda65f213afd service nova] Creating event network-changed:a4980d72-c568-47e2-86cf-4feeb9e706c7 for instance 694199a8-e0fe-4c60-87ff-77409ae17040 on hv-cinder-81571 Oct 28 09:57:03.909070 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-5503d3e8-6e4c-4d8e-9b9c-02fb0ad153af req-c7a66c23-2c61-408d-a8c1-eda65f213afd service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036876 Oct 28 09:57:03.909664 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 480/977] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:57:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:04.304042 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-c140155a-9cfd-45f4-b1c2-c50a6e7ec8f3 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:04.304749 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-c140155a-9cfd-45f4-b1c2-c50a6e7ec8f3 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 694199a8-e0fe-4c60-87ff-77409ae17040] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:04.311676 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c140155a-9cfd-45f4-b1c2-c50a6e7ec8f3 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:04.312178 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c140155a-9cfd-45f4-b1c2-c50a6e7ec8f3 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:04.312982 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c140155a-9cfd-45f4-b1c2-c50a6e7ec8f3 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:04.313403 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c140155a-9cfd-45f4-b1c2-c50a6e7ec8f3 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:04.445968 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-c140155a-9cfd-45f4-b1c2-c50a6e7ec8f3 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:04.454814 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-c140155a-9cfd-45f4-b1c2-c50a6e7ec8f3 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/694199a8-e0fe-4c60-87ff-77409ae17040" status: 200 len: 1321 microversion: 2.1 time: 0.154449 Oct 28 09:57:04.455393 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 498/978] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:04 2021] GET /compute/v2.1/servers/694199a8-e0fe-4c60-87ff-77409ae17040 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:05.473208 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-f085dbef-3b66-4209-9a74-8a72b972e77a tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:05.473900 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-f085dbef-3b66-4209-9a74-8a72b972e77a tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 694199a8-e0fe-4c60-87ff-77409ae17040] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:05.481464 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f085dbef-3b66-4209-9a74-8a72b972e77a tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:05.481901 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f085dbef-3b66-4209-9a74-8a72b972e77a tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:05.482729 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f085dbef-3b66-4209-9a74-8a72b972e77a tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:05.483097 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f085dbef-3b66-4209-9a74-8a72b972e77a tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:05.620985 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-f085dbef-3b66-4209-9a74-8a72b972e77a tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:05.629001 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-f085dbef-3b66-4209-9a74-8a72b972e77a tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/694199a8-e0fe-4c60-87ff-77409ae17040" status: 200 len: 1321 microversion: 2.1 time: 0.160170 Oct 28 09:57:05.629592 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 481/979] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:05 2021] GET /compute/v2.1/servers/694199a8-e0fe-4c60-87ff-77409ae17040 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:06.646657 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-30b6eaed-bf37-4065-bdfa-dbe8efbb6765 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:06.647270 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-30b6eaed-bf37-4065-bdfa-dbe8efbb6765 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 694199a8-e0fe-4c60-87ff-77409ae17040] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:06.654705 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-30b6eaed-bf37-4065-bdfa-dbe8efbb6765 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:06.655183 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-30b6eaed-bf37-4065-bdfa-dbe8efbb6765 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:06.656061 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-30b6eaed-bf37-4065-bdfa-dbe8efbb6765 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:06.656458 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-30b6eaed-bf37-4065-bdfa-dbe8efbb6765 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:06.785943 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-30b6eaed-bf37-4065-bdfa-dbe8efbb6765 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:06.793616 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-30b6eaed-bf37-4065-bdfa-dbe8efbb6765 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/694199a8-e0fe-4c60-87ff-77409ae17040" status: 200 len: 1321 microversion: 2.1 time: 0.150597 Oct 28 09:57:06.794188 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 499/980] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:06 2021] GET /compute/v2.1/servers/694199a8-e0fe-4c60-87ff-77409ae17040 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:07.811213 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-33ffa767-ea64-4a06-a1c8-d80ea090953b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:07.812630 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-33ffa767-ea64-4a06-a1c8-d80ea090953b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 694199a8-e0fe-4c60-87ff-77409ae17040] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:07.820246 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-33ffa767-ea64-4a06-a1c8-d80ea090953b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:07.820710 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-33ffa767-ea64-4a06-a1c8-d80ea090953b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:07.821510 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-33ffa767-ea64-4a06-a1c8-d80ea090953b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:07.821935 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-33ffa767-ea64-4a06-a1c8-d80ea090953b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:07.921343 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [req-cc4da884-5ac3-495b-9bdc-97223e769c56 req-9264da52-4edb-43a1-a245-41d1cea4d04c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "694199a8-e0fe-4c60-87ff-77409ae17040", "name": "network-vif-plugged", "status": "completed", "tag": "a4980d72-c568-47e2-86cf-4feeb9e706c7"}]} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:07.922957 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:57:07.922957 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 09:57:07.930865 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-cc4da884-5ac3-495b-9bdc-97223e769c56 req-9264da52-4edb-43a1-a245-41d1cea4d04c service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:07.931221 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-cc4da884-5ac3-495b-9bdc-97223e769c56 req-9264da52-4edb-43a1-a245-41d1cea4d04c service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:07.999121 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.compute.server_external_events [req-cc4da884-5ac3-495b-9bdc-97223e769c56 req-9264da52-4edb-43a1-a245-41d1cea4d04c service nova] Creating event network-vif-plugged:a4980d72-c568-47e2-86cf-4feeb9e706c7 for instance 694199a8-e0fe-4c60-87ff-77409ae17040 on hv-cinder-81571 Oct 28 09:57:07.999121 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [req-cc4da884-5ac3-495b-9bdc-97223e769c56 req-9264da52-4edb-43a1-a245-41d1cea4d04c service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032014 Oct 28 09:57:07.999121 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 500/981] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:57:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:07.999475 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-33ffa767-ea64-4a06-a1c8-d80ea090953b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:07.999475 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-33ffa767-ea64-4a06-a1c8-d80ea090953b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/694199a8-e0fe-4c60-87ff-77409ae17040" status: 200 len: 1321 microversion: 2.1 time: 0.159807 Oct 28 09:57:07.999475 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 482/982] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:07 2021] GET /compute/v2.1/servers/694199a8-e0fe-4c60-87ff-77409ae17040 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:08.984008 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-de7e7213-3ce2-462c-be04-fd467245c6b6 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:08.984626 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-de7e7213-3ce2-462c-be04-fd467245c6b6 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 694199a8-e0fe-4c60-87ff-77409ae17040] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:08.992921 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-de7e7213-3ce2-462c-be04-fd467245c6b6 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:08.993277 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-de7e7213-3ce2-462c-be04-fd467245c6b6 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:08.994074 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-de7e7213-3ce2-462c-be04-fd467245c6b6 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:08.994516 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-de7e7213-3ce2-462c-be04-fd467245c6b6 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:09.128445 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-de7e7213-3ce2-462c-be04-fd467245c6b6 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:09.137383 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-de7e7213-3ce2-462c-be04-fd467245c6b6 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/694199a8-e0fe-4c60-87ff-77409ae17040" status: 200 len: 1321 microversion: 2.1 time: 0.158631 Oct 28 09:57:09.137990 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 501/983] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:08 2021] GET /compute/v2.1/servers/694199a8-e0fe-4c60-87ff-77409ae17040 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:10.156113 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-cb86d0ad-89d3-4a22-acd6-1390003841c1 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:10.157017 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-cb86d0ad-89d3-4a22-acd6-1390003841c1 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 694199a8-e0fe-4c60-87ff-77409ae17040] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:10.163763 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cb86d0ad-89d3-4a22-acd6-1390003841c1 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:10.164201 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cb86d0ad-89d3-4a22-acd6-1390003841c1 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:10.165024 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cb86d0ad-89d3-4a22-acd6-1390003841c1 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:10.165452 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cb86d0ad-89d3-4a22-acd6-1390003841c1 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:10.309533 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-cb86d0ad-89d3-4a22-acd6-1390003841c1 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:10.317877 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-cb86d0ad-89d3-4a22-acd6-1390003841c1 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/694199a8-e0fe-4c60-87ff-77409ae17040" status: 200 len: 1511 microversion: 2.1 time: 0.166858 Oct 28 09:57:10.318563 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 483/984] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:10 2021] GET /compute/v2.1/servers/694199a8-e0fe-4c60-87ff-77409ae17040 => generated 1511 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:10.338485 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-8eb8617a-80c7-418a-b22d-3fc97ef9dce1 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c0c61e6-bc5a-4c61-a2b7-d9c4232511ec"}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:10.339981 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-8eb8617a-80c7-418a-b22d-3fc97ef9dce1 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 694199a8-e0fe-4c60-87ff-77409ae17040] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:10.346727 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8eb8617a-80c7-418a-b22d-3fc97ef9dce1 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:10.347175 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8eb8617a-80c7-418a-b22d-3fc97ef9dce1 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:10.347949 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8eb8617a-80c7-418a-b22d-3fc97ef9dce1 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:10.348376 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8eb8617a-80c7-418a-b22d-3fc97ef9dce1 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:10.430091 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.wsgi [None req-8eb8617a-80c7-418a-b22d-3fc97ef9dce1 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] HTTP exception thrown: Invalid volume: volume 9c0c61e6-bc5a-4c61-a2b7-d9c4232511ec is already attached to instances: 02a6163e-083b-464d-8650-77d3e421ffa6 Oct 28 09:57:10.436738 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-8eb8617a-80c7-418a-b22d-3fc97ef9dce1 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Returning 400 to user: Invalid volume: volume 9c0c61e6-bc5a-4c61-a2b7-d9c4232511ec is already attached to instances: 02a6163e-083b-464d-8650-77d3e421ffa6 {{(pid=123069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:57:10.436738 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-8eb8617a-80c7-418a-b22d-3fc97ef9dce1 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "POST /compute/v2.1/servers/694199a8-e0fe-4c60-87ff-77409ae17040/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099411 Oct 28 09:57:10.436738 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 502/985] 10.222.0.104 () {60 vars in 1327 bytes} [Thu Oct 28 09:57:10 2021] POST /compute/v2.1/servers/694199a8-e0fe-4c60-87ff-77409ae17040/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 09:57:10.508392 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-e2009475-fbf4-466d-9636-601815257535 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:10.508975 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-e2009475-fbf4-466d-9636-601815257535 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 02a6163e-083b-464d-8650-77d3e421ffa6] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:10.515274 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e2009475-fbf4-466d-9636-601815257535 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:10.515720 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e2009475-fbf4-466d-9636-601815257535 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:10.516488 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e2009475-fbf4-466d-9636-601815257535 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:10.516984 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e2009475-fbf4-466d-9636-601815257535 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:10.601019 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.objects.instance [None req-e2009475-fbf4-466d-9636-601815257535 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lazy-loading 'services' on Instance uuid 02a6163e-083b-464d-8650-77d3e421ffa6 {{(pid=123068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 09:57:10.869568 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-e2009475-fbf4-466d-9636-601815257535 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "DELETE /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6/os-volume_attachments/9c0c61e6-bc5a-4c61-a2b7-d9c4232511ec" status: 202 len: 0 microversion: 2.1 time: 0.365115 Oct 28 09:57:10.870758 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 484/986] 10.222.0.104 () {58 vars in 1420 bytes} [Thu Oct 28 09:57:10 2021] DELETE /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6/os-volume_attachments/9c0c61e6-bc5a-4c61-a2b7-d9c4232511ec => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:57:10.879545 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-7b1e2575-99fa-49a4-a2d2-49a3156154f3 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:10.880483 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-7b1e2575-99fa-49a4-a2d2-49a3156154f3 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 02a6163e-083b-464d-8650-77d3e421ffa6] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:10.888589 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7b1e2575-99fa-49a4-a2d2-49a3156154f3 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:10.889081 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7b1e2575-99fa-49a4-a2d2-49a3156154f3 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:10.889876 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7b1e2575-99fa-49a4-a2d2-49a3156154f3 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:10.890307 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7b1e2575-99fa-49a4-a2d2-49a3156154f3 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:10.924107 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-7b1e2575-99fa-49a4-a2d2-49a3156154f3 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048271 Oct 28 09:57:10.924861 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 503/987] 10.222.0.104 () {58 vars in 1306 bytes} [Thu Oct 28 09:57:10 2021] GET /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:11.939361 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-04fc7742-3dee-46dd-801e-1a1e38b7c1ab tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:11.940400 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-04fc7742-3dee-46dd-801e-1a1e38b7c1ab tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 02a6163e-083b-464d-8650-77d3e421ffa6] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:11.946686 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-04fc7742-3dee-46dd-801e-1a1e38b7c1ab tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:11.949137 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-04fc7742-3dee-46dd-801e-1a1e38b7c1ab tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:11.949137 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-04fc7742-3dee-46dd-801e-1a1e38b7c1ab tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:11.949137 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-04fc7742-3dee-46dd-801e-1a1e38b7c1ab tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:11.979401 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-04fc7742-3dee-46dd-801e-1a1e38b7c1ab tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044658 Oct 28 09:57:11.980072 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 485/988] 10.222.0.104 () {58 vars in 1306 bytes} [Thu Oct 28 09:57:11 2021] GET /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:12.991346 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-5c584926-4cc4-49a4-becf-8d290de1a322 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:12.992407 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-5c584926-4cc4-49a4-becf-8d290de1a322 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 02a6163e-083b-464d-8650-77d3e421ffa6] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:12.999669 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5c584926-4cc4-49a4-becf-8d290de1a322 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:13.000105 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5c584926-4cc4-49a4-becf-8d290de1a322 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:13.000979 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5c584926-4cc4-49a4-becf-8d290de1a322 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:13.001409 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5c584926-4cc4-49a4-becf-8d290de1a322 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:13.034166 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-5c584926-4cc4-49a4-becf-8d290de1a322 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046516 Oct 28 09:57:13.034754 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 504/989] 10.222.0.104 () {58 vars in 1306 bytes} [Thu Oct 28 09:57:12 2021] GET /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:57:13.147759 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-99a8ffec-6777-4ab9-8e33-4342b9e37fc0 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-288700282", "imageRef": "623b30fc-1d92-46d9-b556-b9b963f3d76c", "flavorRef": "452", "networks": [{"uuid": "138f56a9-ba13-417d-bda4-3ae273e68e25"}]}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:13.205475 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.network.neutron [None req-99a8ffec-6777-4ab9-8e33-4342b9e37fc0 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] validate_networks() for [('138f56a9-ba13-417d-bda4-3ae273e68e25', None, None, None, None, None)] {{(pid=123068) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 09:57:13.587154 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-99a8ffec-6777-4ab9-8e33-4342b9e37fc0 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Flavor limits 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:57:13.587574 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-99a8ffec-6777-4ab9-8e33-4342b9e37fc0 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Image limits 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:57:13.588053 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-99a8ffec-6777-4ab9-8e33-4342b9e37fc0 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Flavor pref 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:57:13.588461 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-99a8ffec-6777-4ab9-8e33-4342b9e37fc0 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Image pref 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:57:13.589487 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-99a8ffec-6777-4ab9-8e33-4342b9e37fc0 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:57:13.598503 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-99a8ffec-6777-4ab9-8e33-4342b9e37fc0 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:13.598942 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-99a8ffec-6777-4ab9-8e33-4342b9e37fc0 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:13.599818 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-99a8ffec-6777-4ab9-8e33-4342b9e37fc0 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:13.600245 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-99a8ffec-6777-4ab9-8e33-4342b9e37fc0 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:13.617187 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.quota [None req-99a8ffec-6777-4ab9-8e33-4342b9e37fc0 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Getting quotas for project b70e48e454564b15803319964d0e32bc. Resources: {'ram', 'cores', 'instances'} {{(pid=123068) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 09:57:13.621998 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.quota [None req-99a8ffec-6777-4ab9-8e33-4342b9e37fc0 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Getting quotas for user fc5490f30a0348bd899c522049f6a528 and project b70e48e454564b15803319964d0e32bc. Resources: {'ram', 'cores', 'instances'} {{(pid=123068) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 09:57:13.632906 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-99a8ffec-6777-4ab9-8e33-4342b9e37fc0 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Going to run 1 instances... {{(pid=123068) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 09:57:13.635226 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-99a8ffec-6777-4ab9-8e33-4342b9e37fc0 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 52d24d67-8434-420c-a2b8-ff0fa019a870] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='623b30fc-1d92-46d9-b556-b9b963f3d76c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 09:57:13.825169 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-99a8ffec-6777-4ab9-8e33-4342b9e37fc0 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.680975 Oct 28 09:57:13.825827 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 486/990] 10.222.0.104 () {60 vars in 1151 bytes} [Thu Oct 28 09:57:13 2021] POST /compute/v2.1/servers => generated 382 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 28 09:57:13.835873 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-e508721b-465f-476a-90ec-bd8e1c66f502 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:13.836747 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-e508721b-465f-476a-90ec-bd8e1c66f502 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 52d24d67-8434-420c-a2b8-ff0fa019a870] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:13.893188 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-e508721b-465f-476a-90ec-bd8e1c66f502 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:13.900098 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-e508721b-465f-476a-90ec-bd8e1c66f502 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870" status: 200 len: 1221 microversion: 2.1 time: 0.068192 Oct 28 09:57:13.900672 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 505/991] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:13 2021] GET /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870 => generated 1221 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:57:14.917867 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-9f7220e6-dda3-4987-8537-62bb81955c4e tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:14.918780 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-9f7220e6-dda3-4987-8537-62bb81955c4e tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 52d24d67-8434-420c-a2b8-ff0fa019a870] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:14.929076 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9f7220e6-dda3-4987-8537-62bb81955c4e tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:14.929519 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9f7220e6-dda3-4987-8537-62bb81955c4e tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:14.930303 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9f7220e6-dda3-4987-8537-62bb81955c4e tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:14.930734 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9f7220e6-dda3-4987-8537-62bb81955c4e tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:14.991059 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-9f7220e6-dda3-4987-8537-62bb81955c4e tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:14.999330 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-9f7220e6-dda3-4987-8537-62bb81955c4e tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870" status: 200 len: 1225 microversion: 2.1 time: 0.086546 Oct 28 09:57:14.999896 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 487/992] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:14 2021] GET /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:16.015713 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-46d56f73-4101-428c-b95c-c168ba82c151 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:16.016315 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-46d56f73-4101-428c-b95c-c168ba82c151 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 52d24d67-8434-420c-a2b8-ff0fa019a870] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:16.023172 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-46d56f73-4101-428c-b95c-c168ba82c151 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:16.023652 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-46d56f73-4101-428c-b95c-c168ba82c151 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:16.024430 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-46d56f73-4101-428c-b95c-c168ba82c151 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:16.024896 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-46d56f73-4101-428c-b95c-c168ba82c151 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:16.095421 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-46d56f73-4101-428c-b95c-c168ba82c151 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:16.103481 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-46d56f73-4101-428c-b95c-c168ba82c151 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870" status: 200 len: 1273 microversion: 2.1 time: 0.091323 Oct 28 09:57:16.104057 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 506/993] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:16 2021] GET /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870 => generated 1273 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:17.121064 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-13a4c022-d31f-4c26-ac06-90ee8036c58b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:17.121920 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-13a4c022-d31f-4c26-ac06-90ee8036c58b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 52d24d67-8434-420c-a2b8-ff0fa019a870] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:17.128738 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-13a4c022-d31f-4c26-ac06-90ee8036c58b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:17.129149 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-13a4c022-d31f-4c26-ac06-90ee8036c58b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:17.130273 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-13a4c022-d31f-4c26-ac06-90ee8036c58b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:17.130910 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-13a4c022-d31f-4c26-ac06-90ee8036c58b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:17.278079 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-13a4c022-d31f-4c26-ac06-90ee8036c58b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:17.291465 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-13a4c022-d31f-4c26-ac06-90ee8036c58b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870" status: 200 len: 1321 microversion: 2.1 time: 0.173729 Oct 28 09:57:17.298217 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 488/994] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:17 2021] GET /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:18.209115 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [req-60462bcb-ed0d-49cd-b745-3b2112ba8ff5 req-dcb0fd23-3930-4fbb-bce1-2f703bc42064 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d24d67-8434-420c-a2b8-ff0fa019a870", "tag": "0bed67f6-e6ea-496f-9c92-15d0b605ebff"}]} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:18.211631 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:57:18.211631 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 09:57:18.219983 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-60462bcb-ed0d-49cd-b745-3b2112ba8ff5 req-dcb0fd23-3930-4fbb-bce1-2f703bc42064 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:18.220448 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-60462bcb-ed0d-49cd-b745-3b2112ba8ff5 req-dcb0fd23-3930-4fbb-bce1-2f703bc42064 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:18.232698 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.compute.server_external_events [req-60462bcb-ed0d-49cd-b745-3b2112ba8ff5 req-dcb0fd23-3930-4fbb-bce1-2f703bc42064 service nova] Creating event network-changed:0bed67f6-e6ea-496f-9c92-15d0b605ebff for instance 52d24d67-8434-420c-a2b8-ff0fa019a870 on hv-cinder-81571 Oct 28 09:57:18.238484 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [req-60462bcb-ed0d-49cd-b745-3b2112ba8ff5 req-dcb0fd23-3930-4fbb-bce1-2f703bc42064 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033216 Oct 28 09:57:18.239279 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 507/995] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:57:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:57:18.319129 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-0b894911-1615-47d5-9229-a0aa75776148 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:18.319758 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-0b894911-1615-47d5-9229-a0aa75776148 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 52d24d67-8434-420c-a2b8-ff0fa019a870] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:18.327055 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0b894911-1615-47d5-9229-a0aa75776148 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:18.327496 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0b894911-1615-47d5-9229-a0aa75776148 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:18.328277 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0b894911-1615-47d5-9229-a0aa75776148 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:18.328900 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0b894911-1615-47d5-9229-a0aa75776148 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:18.458178 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-0b894911-1615-47d5-9229-a0aa75776148 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:18.466541 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-0b894911-1615-47d5-9229-a0aa75776148 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870" status: 200 len: 1321 microversion: 2.1 time: 0.151019 Oct 28 09:57:18.476469 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 489/996] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:18 2021] GET /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:18.672511 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-800b48fe-fe56-48a6-a514-213498e1cb70 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-62316904", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-87968533", "security_groups": [{"name": "tempest-secgroup-smoke-1252555229"}], "block_device_mapping_v2": [{"uuid": "d2182ad6-0e5b-450c-a786-c9f6b22c88c7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5478037d-e561-4e8b-811e-6f93ca4dff8e"}]}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:18.775987 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.network.neutron [None req-800b48fe-fe56-48a6-a514-213498e1cb70 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] validate_networks() for [('5478037d-e561-4e8b-811e-6f93ca4dff8e', None, None, None, None, None)] {{(pid=123069) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 09:57:19.169020 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-800b48fe-fe56-48a6-a514-213498e1cb70 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Flavor limits 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:57:19.169477 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-800b48fe-fe56-48a6-a514-213498e1cb70 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Image limits 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:57:19.169940 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-800b48fe-fe56-48a6-a514-213498e1cb70 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Flavor pref 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:57:19.170344 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-800b48fe-fe56-48a6-a514-213498e1cb70 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Image pref 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:57:19.170753 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-800b48fe-fe56-48a6-a514-213498e1cb70 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:57:19.180299 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-800b48fe-fe56-48a6-a514-213498e1cb70 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:19.180777 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-800b48fe-fe56-48a6-a514-213498e1cb70 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:19.181638 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-800b48fe-fe56-48a6-a514-213498e1cb70 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:19.182910 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-800b48fe-fe56-48a6-a514-213498e1cb70 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:19.200331 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.quota [None req-800b48fe-fe56-48a6-a514-213498e1cb70 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Getting quotas for project 8891d4ce726f4b84a18cbb3bce4e53c3. Resources: {'ram', 'cores', 'instances'} {{(pid=123069) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 09:57:19.204667 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.quota [None req-800b48fe-fe56-48a6-a514-213498e1cb70 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Getting quotas for user c6c7a9975b554c30956dcd3d34b93a97 and project 8891d4ce726f4b84a18cbb3bce4e53c3. Resources: {'ram', 'cores', 'instances'} {{(pid=123069) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 09:57:19.262543 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-800b48fe-fe56-48a6-a514-213498e1cb70 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Going to run 1 instances... {{(pid=123069) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 09:57:19.264818 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-800b48fe-fe56-48a6-a514-213498e1cb70 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 0d8c7f9d-ae44-4516-a430-e19cf05cda9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d2182ad6-0e5b-450c-a786-c9f6b22c88c7',volume_size=None,volume_type=None)] {{(pid=123069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 09:57:19.483557 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-00d93826-f40a-4d55-8637-74af5569defe tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:19.484140 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-00d93826-f40a-4d55-8637-74af5569defe tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 52d24d67-8434-420c-a2b8-ff0fa019a870] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:19.490387 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-00d93826-f40a-4d55-8637-74af5569defe tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:19.490819 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-00d93826-f40a-4d55-8637-74af5569defe tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:19.491614 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-00d93826-f40a-4d55-8637-74af5569defe tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:19.492042 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-00d93826-f40a-4d55-8637-74af5569defe tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:19.620063 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-00d93826-f40a-4d55-8637-74af5569defe tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:19.627778 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-00d93826-f40a-4d55-8637-74af5569defe tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870" status: 200 len: 1321 microversion: 2.1 time: 0.148410 Oct 28 09:57:19.628353 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 490/997] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:19 2021] GET /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:57:19.842423 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-800b48fe-fe56-48a6-a514-213498e1cb70 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.174051 Oct 28 09:57:19.843388 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 508/998] 10.222.0.104 () {60 vars in 1151 bytes} [Thu Oct 28 09:57:18 2021] POST /compute/v2.1/servers => generated 408 bytes in 1176 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 28 09:57:19.853063 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-c85512f9-76ce-4df7-9a80-789992dceefb tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:19.853805 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-c85512f9-76ce-4df7-9a80-789992dceefb tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 0d8c7f9d-ae44-4516-a430-e19cf05cda9f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:19.907665 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-c85512f9-76ce-4df7-9a80-789992dceefb tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:19.914341 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-c85512f9-76ce-4df7-9a80-789992dceefb tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f" status: 200 len: 1094 microversion: 2.1 time: 0.065046 Oct 28 09:57:19.914980 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 491/999] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:19 2021] GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:20.644541 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-a4903138-0371-43e5-b432-de9831af4890 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:20.645198 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-a4903138-0371-43e5-b432-de9831af4890 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 52d24d67-8434-420c-a2b8-ff0fa019a870] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:20.652610 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a4903138-0371-43e5-b432-de9831af4890 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:20.653080 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a4903138-0371-43e5-b432-de9831af4890 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:20.653794 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a4903138-0371-43e5-b432-de9831af4890 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:20.654230 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a4903138-0371-43e5-b432-de9831af4890 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:20.785003 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-a4903138-0371-43e5-b432-de9831af4890 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:20.793525 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-a4903138-0371-43e5-b432-de9831af4890 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870" status: 200 len: 1321 microversion: 2.1 time: 0.152435 Oct 28 09:57:20.794113 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 509/1000] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:20 2021] GET /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:20.938342 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-a30159d2-c9b1-4679-982f-9b3369e21b4d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:20.938342 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-a30159d2-c9b1-4679-982f-9b3369e21b4d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 0d8c7f9d-ae44-4516-a430-e19cf05cda9f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:20.986136 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-a30159d2-c9b1-4679-982f-9b3369e21b4d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:20.992732 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-a30159d2-c9b1-4679-982f-9b3369e21b4d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f" status: 200 len: 1094 microversion: 2.1 time: 0.065024 Oct 28 09:57:20.993301 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 492/1001] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:20 2021] GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:21.811328 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-fb29ac3d-234a-40da-a31c-c9864c593381 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:21.811953 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-fb29ac3d-234a-40da-a31c-c9864c593381 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 52d24d67-8434-420c-a2b8-ff0fa019a870] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:21.818453 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fb29ac3d-234a-40da-a31c-c9864c593381 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:21.818890 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fb29ac3d-234a-40da-a31c-c9864c593381 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:21.819659 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fb29ac3d-234a-40da-a31c-c9864c593381 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:21.820083 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fb29ac3d-234a-40da-a31c-c9864c593381 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:21.952624 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-fb29ac3d-234a-40da-a31c-c9864c593381 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:21.960080 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-fb29ac3d-234a-40da-a31c-c9864c593381 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870" status: 200 len: 1321 microversion: 2.1 time: 0.154187 Oct 28 09:57:21.960641 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 510/1002] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:21 2021] GET /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:22.010511 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-f4542e7a-1bbf-42ea-a25d-022b9f5e39cb tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:22.011101 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-f4542e7a-1bbf-42ea-a25d-022b9f5e39cb tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 0d8c7f9d-ae44-4516-a430-e19cf05cda9f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:22.018668 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f4542e7a-1bbf-42ea-a25d-022b9f5e39cb tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:22.022660 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f4542e7a-1bbf-42ea-a25d-022b9f5e39cb tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:22.022660 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f4542e7a-1bbf-42ea-a25d-022b9f5e39cb tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:22.022660 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f4542e7a-1bbf-42ea-a25d-022b9f5e39cb tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:22.082419 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-f4542e7a-1bbf-42ea-a25d-022b9f5e39cb tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:22.091162 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-f4542e7a-1bbf-42ea-a25d-022b9f5e39cb tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f" status: 200 len: 1192 microversion: 2.1 time: 0.084490 Oct 28 09:57:22.091784 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 493/1003] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:22 2021] GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f => generated 1192 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:22.977574 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-eedc3101-1508-4144-8225-cd28dcecb6ed tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:22.978814 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-eedc3101-1508-4144-8225-cd28dcecb6ed tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 52d24d67-8434-420c-a2b8-ff0fa019a870] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:22.985729 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-eedc3101-1508-4144-8225-cd28dcecb6ed tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:22.986262 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-eedc3101-1508-4144-8225-cd28dcecb6ed tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:22.987245 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-eedc3101-1508-4144-8225-cd28dcecb6ed tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:22.987846 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-eedc3101-1508-4144-8225-cd28dcecb6ed tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:23.108172 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-940fb2d4-2c09-4c0d-80ca-9ba81e24feaa tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:23.108910 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-940fb2d4-2c09-4c0d-80ca-9ba81e24feaa tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 0d8c7f9d-ae44-4516-a430-e19cf05cda9f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:23.116050 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-940fb2d4-2c09-4c0d-80ca-9ba81e24feaa tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:23.116498 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-940fb2d4-2c09-4c0d-80ca-9ba81e24feaa tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:23.119755 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-940fb2d4-2c09-4c0d-80ca-9ba81e24feaa tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:23.121548 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-940fb2d4-2c09-4c0d-80ca-9ba81e24feaa tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:23.124062 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-eedc3101-1508-4144-8225-cd28dcecb6ed tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:23.132093 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-eedc3101-1508-4144-8225-cd28dcecb6ed tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870" status: 200 len: 1321 microversion: 2.1 time: 0.158194 Oct 28 09:57:23.132697 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 511/1004] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:22 2021] GET /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:23.193663 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-940fb2d4-2c09-4c0d-80ca-9ba81e24feaa tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:23.207839 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-940fb2d4-2c09-4c0d-80ca-9ba81e24feaa tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f" status: 200 len: 1210 microversion: 2.1 time: 0.103361 Oct 28 09:57:23.208864 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 494/1005] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:23 2021] GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f => generated 1210 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:57:23.897578 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [req-bc1b0c50-2c46-43fa-a48f-e3d79d60d6a5 req-3daf2931-3db7-46cf-9d96-03928b8aa0a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d24d67-8434-420c-a2b8-ff0fa019a870", "name": "network-vif-plugged", "status": "completed", "tag": "0bed67f6-e6ea-496f-9c92-15d0b605ebff"}]} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:23.899246 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:57:23.899246 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 09:57:23.907661 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-bc1b0c50-2c46-43fa-a48f-e3d79d60d6a5 req-3daf2931-3db7-46cf-9d96-03928b8aa0a4 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:23.908900 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-bc1b0c50-2c46-43fa-a48f-e3d79d60d6a5 req-3daf2931-3db7-46cf-9d96-03928b8aa0a4 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:23.922888 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.compute.server_external_events [req-bc1b0c50-2c46-43fa-a48f-e3d79d60d6a5 req-3daf2931-3db7-46cf-9d96-03928b8aa0a4 service nova] Creating event network-vif-plugged:0bed67f6-e6ea-496f-9c92-15d0b605ebff for instance 52d24d67-8434-420c-a2b8-ff0fa019a870 on hv-cinder-81571 Oct 28 09:57:23.928618 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [req-bc1b0c50-2c46-43fa-a48f-e3d79d60d6a5 req-3daf2931-3db7-46cf-9d96-03928b8aa0a4 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034780 Oct 28 09:57:23.934098 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 512/1006] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:57:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:57:24.150855 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-1dcfd0c4-7eb6-405b-b9b5-8f42ee821d6a tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:24.152785 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-1dcfd0c4-7eb6-405b-b9b5-8f42ee821d6a tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 52d24d67-8434-420c-a2b8-ff0fa019a870] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:24.159636 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1dcfd0c4-7eb6-405b-b9b5-8f42ee821d6a tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:24.160192 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1dcfd0c4-7eb6-405b-b9b5-8f42ee821d6a tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:24.161243 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1dcfd0c4-7eb6-405b-b9b5-8f42ee821d6a tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:24.161746 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-1dcfd0c4-7eb6-405b-b9b5-8f42ee821d6a tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:24.237064 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-d2d4f122-6390-4c7d-a800-b132a1f3915e tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:24.237773 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-d2d4f122-6390-4c7d-a800-b132a1f3915e tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 0d8c7f9d-ae44-4516-a430-e19cf05cda9f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:24.245702 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d2d4f122-6390-4c7d-a800-b132a1f3915e tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:24.246190 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d2d4f122-6390-4c7d-a800-b132a1f3915e tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:24.247695 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d2d4f122-6390-4c7d-a800-b132a1f3915e tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:24.248303 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d2d4f122-6390-4c7d-a800-b132a1f3915e tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:24.389728 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-1dcfd0c4-7eb6-405b-b9b5-8f42ee821d6a tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:24.397376 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-1dcfd0c4-7eb6-405b-b9b5-8f42ee821d6a tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870" status: 200 len: 1321 microversion: 2.1 time: 0.249974 Oct 28 09:57:24.397955 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 495/1007] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:24 2021] GET /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870 => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:24.480870 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-d2d4f122-6390-4c7d-a800-b132a1f3915e tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:24.489217 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-d2d4f122-6390-4c7d-a800-b132a1f3915e tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f" status: 200 len: 1278 microversion: 2.1 time: 0.256278 Oct 28 09:57:24.490420 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 513/1008] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:24 2021] GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f => generated 1278 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:57:24.534981 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-0316db1d-d1ac-4308-9d06-2a3a5da01916 req-991bb1b9-5aa7-4170-aa99-c74956a76e6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d8c7f9d-ae44-4516-a430-e19cf05cda9f", "tag": "ab88f822-dd8c-4d3c-aaeb-f786c078a662"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:24.536713 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:57:24.536713 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:57:24.544865 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-0316db1d-d1ac-4308-9d06-2a3a5da01916 req-991bb1b9-5aa7-4170-aa99-c74956a76e6e service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:24.545555 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-0316db1d-d1ac-4308-9d06-2a3a5da01916 req-991bb1b9-5aa7-4170-aa99-c74956a76e6e service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:24.558476 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-0316db1d-d1ac-4308-9d06-2a3a5da01916 req-991bb1b9-5aa7-4170-aa99-c74956a76e6e service nova] Creating event network-changed:ab88f822-dd8c-4d3c-aaeb-f786c078a662 for instance 0d8c7f9d-ae44-4516-a430-e19cf05cda9f on hv-cinder-81571 Oct 28 09:57:24.564460 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-0316db1d-d1ac-4308-9d06-2a3a5da01916 req-991bb1b9-5aa7-4170-aa99-c74956a76e6e service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033432 Oct 28 09:57:24.564868 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 496/1009] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:57:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:25.415421 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-aabc31a6-6f82-4633-ba6a-2342e6ec3420 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:25.415968 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-aabc31a6-6f82-4633-ba6a-2342e6ec3420 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 52d24d67-8434-420c-a2b8-ff0fa019a870] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:25.423555 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-aabc31a6-6f82-4633-ba6a-2342e6ec3420 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:25.424003 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-aabc31a6-6f82-4633-ba6a-2342e6ec3420 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:25.424829 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-aabc31a6-6f82-4633-ba6a-2342e6ec3420 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:25.425257 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-aabc31a6-6f82-4633-ba6a-2342e6ec3420 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:25.507220 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-99e5a648-7807-41c1-ab02-40eb2692ebf8 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:25.507947 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-99e5a648-7807-41c1-ab02-40eb2692ebf8 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 0d8c7f9d-ae44-4516-a430-e19cf05cda9f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:25.514710 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-99e5a648-7807-41c1-ab02-40eb2692ebf8 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:25.515225 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-99e5a648-7807-41c1-ab02-40eb2692ebf8 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:25.516034 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-99e5a648-7807-41c1-ab02-40eb2692ebf8 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:25.516458 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-99e5a648-7807-41c1-ab02-40eb2692ebf8 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:25.594255 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-aabc31a6-6f82-4633-ba6a-2342e6ec3420 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:25.601880 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-aabc31a6-6f82-4633-ba6a-2342e6ec3420 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870" status: 200 len: 1321 microversion: 2.1 time: 0.190271 Oct 28 09:57:25.602523 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 514/1010] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:25 2021] GET /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870 => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:25.660409 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-99e5a648-7807-41c1-ab02-40eb2692ebf8 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:25.678565 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-99e5a648-7807-41c1-ab02-40eb2692ebf8 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f" status: 200 len: 1266 microversion: 2.1 time: 0.169119 Oct 28 09:57:25.678565 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 497/1011] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:25 2021] GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:57:26.619582 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-a16eba0f-0fe9-4224-85d5-3e45068cb59c tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:26.620182 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-a16eba0f-0fe9-4224-85d5-3e45068cb59c tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 52d24d67-8434-420c-a2b8-ff0fa019a870] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:26.627454 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a16eba0f-0fe9-4224-85d5-3e45068cb59c tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:26.627883 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a16eba0f-0fe9-4224-85d5-3e45068cb59c tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:26.628720 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a16eba0f-0fe9-4224-85d5-3e45068cb59c tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:26.629087 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a16eba0f-0fe9-4224-85d5-3e45068cb59c tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:26.690244 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-3790b9b5-b77d-4d6a-b645-5a6ade010545 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:26.690858 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-3790b9b5-b77d-4d6a-b645-5a6ade010545 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 0d8c7f9d-ae44-4516-a430-e19cf05cda9f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:26.697510 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3790b9b5-b77d-4d6a-b645-5a6ade010545 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:26.697969 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3790b9b5-b77d-4d6a-b645-5a6ade010545 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:26.698731 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3790b9b5-b77d-4d6a-b645-5a6ade010545 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:26.699153 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3790b9b5-b77d-4d6a-b645-5a6ade010545 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:26.786578 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-a16eba0f-0fe9-4224-85d5-3e45068cb59c tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:26.795655 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-a16eba0f-0fe9-4224-85d5-3e45068cb59c tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870" status: 200 len: 1512 microversion: 2.1 time: 0.179770 Oct 28 09:57:26.796237 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 515/1012] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:26 2021] GET /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870 => generated 1512 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:26.847691 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-3790b9b5-b77d-4d6a-b645-5a6ade010545 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:26.855008 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-3790b9b5-b77d-4d6a-b645-5a6ade010545 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f" status: 200 len: 1266 microversion: 2.1 time: 0.168379 Oct 28 09:57:26.856184 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 498/1013] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:26 2021] GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:27.873714 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-0a1281c7-7ff8-4032-a095-dd5f640a881c tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:27.874326 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-0a1281c7-7ff8-4032-a095-dd5f640a881c tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 0d8c7f9d-ae44-4516-a430-e19cf05cda9f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:27.880742 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0a1281c7-7ff8-4032-a095-dd5f640a881c tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:27.881186 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0a1281c7-7ff8-4032-a095-dd5f640a881c tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:27.881957 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0a1281c7-7ff8-4032-a095-dd5f640a881c tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:27.882437 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0a1281c7-7ff8-4032-a095-dd5f640a881c tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:28.010199 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-0a1281c7-7ff8-4032-a095-dd5f640a881c tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:28.018459 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-0a1281c7-7ff8-4032-a095-dd5f640a881c tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f" status: 200 len: 1266 microversion: 2.1 time: 0.149307 Oct 28 09:57:28.019032 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 516/1014] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:27 2021] GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:28.478611 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-7cc6befb-2f08-4b5a-9952-62fbd7c7ea77 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18075d28-9d92-4a11-b718-c20c84705a89"}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:28.479664 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-7cc6befb-2f08-4b5a-9952-62fbd7c7ea77 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 52d24d67-8434-420c-a2b8-ff0fa019a870] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:28.486506 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7cc6befb-2f08-4b5a-9952-62fbd7c7ea77 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:28.486945 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7cc6befb-2f08-4b5a-9952-62fbd7c7ea77 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:28.487719 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7cc6befb-2f08-4b5a-9952-62fbd7c7ea77 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:28.488153 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7cc6befb-2f08-4b5a-9952-62fbd7c7ea77 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:29.035298 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-6fdc177e-ba65-47b2-bf9d-2053571f42f3 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:29.035860 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-6fdc177e-ba65-47b2-bf9d-2053571f42f3 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 0d8c7f9d-ae44-4516-a430-e19cf05cda9f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:29.042418 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6fdc177e-ba65-47b2-bf9d-2053571f42f3 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:29.042973 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6fdc177e-ba65-47b2-bf9d-2053571f42f3 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:29.043905 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6fdc177e-ba65-47b2-bf9d-2053571f42f3 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:29.044332 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6fdc177e-ba65-47b2-bf9d-2053571f42f3 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:29.173875 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-6fdc177e-ba65-47b2-bf9d-2053571f42f3 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:29.186273 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-6fdc177e-ba65-47b2-bf9d-2053571f42f3 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f" status: 200 len: 1266 microversion: 2.1 time: 0.153761 Oct 28 09:57:29.187809 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 517/1015] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:29 2021] GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:57:29.467110 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-7cc6befb-2f08-4b5a-9952-62fbd7c7ea77 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "POST /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.992133 Oct 28 09:57:29.467720 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 499/1016] 10.222.0.104 () {60 vars in 1327 bytes} [Thu Oct 28 09:57:28 2021] POST /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870/os-volume_attachments => generated 194 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:30.204293 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-f2364687-05c5-47a3-83e3-51b6b5604eb3 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:30.204934 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-f2364687-05c5-47a3-83e3-51b6b5604eb3 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 0d8c7f9d-ae44-4516-a430-e19cf05cda9f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:30.211243 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f2364687-05c5-47a3-83e3-51b6b5604eb3 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:30.211680 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f2364687-05c5-47a3-83e3-51b6b5604eb3 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:30.212447 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f2364687-05c5-47a3-83e3-51b6b5604eb3 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:30.212906 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f2364687-05c5-47a3-83e3-51b6b5604eb3 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:30.341178 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-f2364687-05c5-47a3-83e3-51b6b5604eb3 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:30.349329 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-f2364687-05c5-47a3-83e3-51b6b5604eb3 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f" status: 200 len: 1266 microversion: 2.1 time: 0.148637 Oct 28 09:57:30.349953 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 518/1017] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:30 2021] GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:31.371952 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-c6805e5d-fa21-46c6-989d-694e760375d9 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:31.372955 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-c6805e5d-fa21-46c6-989d-694e760375d9 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 0d8c7f9d-ae44-4516-a430-e19cf05cda9f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:31.379227 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c6805e5d-fa21-46c6-989d-694e760375d9 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:31.379695 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c6805e5d-fa21-46c6-989d-694e760375d9 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:31.380490 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c6805e5d-fa21-46c6-989d-694e760375d9 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:31.380961 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c6805e5d-fa21-46c6-989d-694e760375d9 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:31.510373 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-c6805e5d-fa21-46c6-989d-694e760375d9 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:31.517858 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-c6805e5d-fa21-46c6-989d-694e760375d9 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f" status: 200 len: 1266 microversion: 2.1 time: 0.151567 Oct 28 09:57:31.518443 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 500/1018] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:31 2021] GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:57:32.534558 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-877511f7-2474-434b-9347-a9565b28010d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:32.535171 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-877511f7-2474-434b-9347-a9565b28010d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 0d8c7f9d-ae44-4516-a430-e19cf05cda9f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:32.541568 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-877511f7-2474-434b-9347-a9565b28010d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:32.542011 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-877511f7-2474-434b-9347-a9565b28010d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:32.542848 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-877511f7-2474-434b-9347-a9565b28010d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:32.543308 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-877511f7-2474-434b-9347-a9565b28010d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:32.672569 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-877511f7-2474-434b-9347-a9565b28010d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:32.680444 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-877511f7-2474-434b-9347-a9565b28010d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f" status: 200 len: 1266 microversion: 2.1 time: 0.149510 Oct 28 09:57:32.681080 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 519/1019] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:32 2021] GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:33.700168 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-821449ff-74b1-4208-a9f6-26b4c7082c44 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:33.701108 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-821449ff-74b1-4208-a9f6-26b4c7082c44 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 0d8c7f9d-ae44-4516-a430-e19cf05cda9f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:33.707678 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-821449ff-74b1-4208-a9f6-26b4c7082c44 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:33.708125 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-821449ff-74b1-4208-a9f6-26b4c7082c44 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:33.709475 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-821449ff-74b1-4208-a9f6-26b4c7082c44 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:33.709917 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-821449ff-74b1-4208-a9f6-26b4c7082c44 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:33.844379 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-821449ff-74b1-4208-a9f6-26b4c7082c44 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:33.851952 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-821449ff-74b1-4208-a9f6-26b4c7082c44 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f" status: 200 len: 1266 microversion: 2.1 time: 0.156343 Oct 28 09:57:33.852537 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 501/1020] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:33 2021] GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:33.918114 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [req-ca2543f6-85d0-4951-b033-ac87b712f0be req-48878ca1-9a43-43fa-a26e-d6091467ac5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d8c7f9d-ae44-4516-a430-e19cf05cda9f", "name": "network-vif-plugged", "status": "completed", "tag": "ab88f822-dd8c-4d3c-aaeb-f786c078a662"}]} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:33.920199 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:57:33.920199 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 09:57:33.927586 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-ca2543f6-85d0-4951-b033-ac87b712f0be req-48878ca1-9a43-43fa-a26e-d6091467ac5f service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:33.928095 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-ca2543f6-85d0-4951-b033-ac87b712f0be req-48878ca1-9a43-43fa-a26e-d6091467ac5f service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:33.940816 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.compute.server_external_events [req-ca2543f6-85d0-4951-b033-ac87b712f0be req-48878ca1-9a43-43fa-a26e-d6091467ac5f service nova] Creating event network-vif-plugged:ab88f822-dd8c-4d3c-aaeb-f786c078a662 for instance 0d8c7f9d-ae44-4516-a430-e19cf05cda9f on hv-cinder-81571 Oct 28 09:57:33.946342 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [req-ca2543f6-85d0-4951-b033-ac87b712f0be req-48878ca1-9a43-43fa-a26e-d6091467ac5f service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032383 Oct 28 09:57:33.946940 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 520/1021] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:57:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:34.872340 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-b732fdce-343b-4a7b-a8bb-83484a99d8fc tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:34.872971 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-b732fdce-343b-4a7b-a8bb-83484a99d8fc tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 0d8c7f9d-ae44-4516-a430-e19cf05cda9f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:34.879151 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b732fdce-343b-4a7b-a8bb-83484a99d8fc tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:34.879586 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b732fdce-343b-4a7b-a8bb-83484a99d8fc tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:34.880351 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b732fdce-343b-4a7b-a8bb-83484a99d8fc tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:34.880806 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b732fdce-343b-4a7b-a8bb-83484a99d8fc tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:35.010499 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-b732fdce-343b-4a7b-a8bb-83484a99d8fc tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:35.018744 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-b732fdce-343b-4a7b-a8bb-83484a99d8fc tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f" status: 200 len: 1266 microversion: 2.1 time: 0.150951 Oct 28 09:57:35.019315 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 502/1022] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:34 2021] GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:36.036437 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-c12531dc-0672-4c99-b7a3-d8fdcd9c1636 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:36.037163 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-c12531dc-0672-4c99-b7a3-d8fdcd9c1636 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 0d8c7f9d-ae44-4516-a430-e19cf05cda9f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:36.043903 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c12531dc-0672-4c99-b7a3-d8fdcd9c1636 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:36.044344 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c12531dc-0672-4c99-b7a3-d8fdcd9c1636 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:36.045152 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c12531dc-0672-4c99-b7a3-d8fdcd9c1636 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:36.045582 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c12531dc-0672-4c99-b7a3-d8fdcd9c1636 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:36.170768 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-c12531dc-0672-4c99-b7a3-d8fdcd9c1636 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:36.178148 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-c12531dc-0672-4c99-b7a3-d8fdcd9c1636 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f" status: 200 len: 1453 microversion: 2.1 time: 0.146268 Oct 28 09:57:36.178840 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 521/1023] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:36 2021] GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:36.194813 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-77a644d3-fd14-437a-9106-d34ccf0c6d88 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:36.195416 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-77a644d3-fd14-437a-9106-d34ccf0c6d88 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 0d8c7f9d-ae44-4516-a430-e19cf05cda9f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:36.202425 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-77a644d3-fd14-437a-9106-d34ccf0c6d88 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:36.202866 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-77a644d3-fd14-437a-9106-d34ccf0c6d88 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:36.203627 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-77a644d3-fd14-437a-9106-d34ccf0c6d88 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:36.204060 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-77a644d3-fd14-437a-9106-d34ccf0c6d88 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:36.327079 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-77a644d3-fd14-437a-9106-d34ccf0c6d88 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:36.334599 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-77a644d3-fd14-437a-9106-d34ccf0c6d88 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f" status: 200 len: 1453 microversion: 2.1 time: 0.143772 Oct 28 09:57:36.335172 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 503/1024] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:36 2021] GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f => generated 1453 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:36.987409 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-7b280ded-7617-4697-9202-9d5ae5363374 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18075d28-9d92-4a11-b718-c20c84705a89"}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:36.988491 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-7b280ded-7617-4697-9202-9d5ae5363374 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 52d24d67-8434-420c-a2b8-ff0fa019a870] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:36.994517 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7b280ded-7617-4697-9202-9d5ae5363374 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:36.994955 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7b280ded-7617-4697-9202-9d5ae5363374 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:36.996618 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7b280ded-7617-4697-9202-9d5ae5363374 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:36.997093 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7b280ded-7617-4697-9202-9d5ae5363374 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:37.086882 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.wsgi [None req-7b280ded-7617-4697-9202-9d5ae5363374 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] HTTP exception thrown: Invalid volume: volume 18075d28-9d92-4a11-b718-c20c84705a89 is already attached to instances: 52d24d67-8434-420c-a2b8-ff0fa019a870 Oct 28 09:57:37.087613 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-7b280ded-7617-4697-9202-9d5ae5363374 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Returning 400 to user: Invalid volume: volume 18075d28-9d92-4a11-b718-c20c84705a89 is already attached to instances: 52d24d67-8434-420c-a2b8-ff0fa019a870 {{(pid=123069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:57:37.088341 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-7b280ded-7617-4697-9202-9d5ae5363374 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "POST /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104846 Oct 28 09:57:37.088928 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 522/1025] 10.222.0.104 () {60 vars in 1327 bytes} [Thu Oct 28 09:57:36 2021] POST /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 09:57:37.147284 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-d4e550a8-1d35-4a6f-ab1b-ae3a2c145d42 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:37.147776 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-d4e550a8-1d35-4a6f-ab1b-ae3a2c145d42 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 52d24d67-8434-420c-a2b8-ff0fa019a870] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:37.154817 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d4e550a8-1d35-4a6f-ab1b-ae3a2c145d42 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:37.155191 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d4e550a8-1d35-4a6f-ab1b-ae3a2c145d42 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:37.155974 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d4e550a8-1d35-4a6f-ab1b-ae3a2c145d42 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:37.156410 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d4e550a8-1d35-4a6f-ab1b-ae3a2c145d42 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:37.236019 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.objects.instance [None req-d4e550a8-1d35-4a6f-ab1b-ae3a2c145d42 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lazy-loading 'services' on Instance uuid 52d24d67-8434-420c-a2b8-ff0fa019a870 {{(pid=123068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 09:57:37.438925 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-d4e550a8-1d35-4a6f-ab1b-ae3a2c145d42 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "DELETE /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870/os-volume_attachments/18075d28-9d92-4a11-b718-c20c84705a89" status: 202 len: 0 microversion: 2.1 time: 0.295213 Oct 28 09:57:37.439524 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 504/1026] 10.222.0.104 () {58 vars in 1420 bytes} [Thu Oct 28 09:57:37 2021] DELETE /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870/os-volume_attachments/18075d28-9d92-4a11-b718-c20c84705a89 => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:57:37.448751 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-40fe8182-86a2-45e0-a2f1-998023b389e3 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:37.449756 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-40fe8182-86a2-45e0-a2f1-998023b389e3 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 52d24d67-8434-420c-a2b8-ff0fa019a870] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:37.456950 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-40fe8182-86a2-45e0-a2f1-998023b389e3 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:37.457397 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-40fe8182-86a2-45e0-a2f1-998023b389e3 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:37.458167 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-40fe8182-86a2-45e0-a2f1-998023b389e3 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:37.458592 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-40fe8182-86a2-45e0-a2f1-998023b389e3 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:37.489394 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-40fe8182-86a2-45e0-a2f1-998023b389e3 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045221 Oct 28 09:57:37.489954 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 523/1027] 10.222.0.104 () {58 vars in 1306 bytes} [Thu Oct 28 09:57:37 2021] GET /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:38.503966 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-5c9c9641-c237-4b36-87cc-77db65c1544b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:38.504449 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-5c9c9641-c237-4b36-87cc-77db65c1544b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 52d24d67-8434-420c-a2b8-ff0fa019a870] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:38.511274 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5c9c9641-c237-4b36-87cc-77db65c1544b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:38.511716 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5c9c9641-c237-4b36-87cc-77db65c1544b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:38.512745 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5c9c9641-c237-4b36-87cc-77db65c1544b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:38.513364 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5c9c9641-c237-4b36-87cc-77db65c1544b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:38.543873 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-5c9c9641-c237-4b36-87cc-77db65c1544b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045500 Oct 28 09:57:38.547995 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 505/1028] 10.222.0.104 () {58 vars in 1306 bytes} [Thu Oct 28 09:57:38 2021] GET /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:57:38.640412 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [req-26a818cd-9a76-4f74-a3fc-b52f4e9533f1 req-e64d4553-b7eb-4fba-94be-0a7e883b260c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d8c7f9d-ae44-4516-a430-e19cf05cda9f", "tag": "ab88f822-dd8c-4d3c-aaeb-f786c078a662"}]} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:38.640412 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:57:38.640412 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 09:57:38.645961 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-26a818cd-9a76-4f74-a3fc-b52f4e9533f1 req-e64d4553-b7eb-4fba-94be-0a7e883b260c service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:38.646234 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-26a818cd-9a76-4f74-a3fc-b52f4e9533f1 req-e64d4553-b7eb-4fba-94be-0a7e883b260c service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:38.658542 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.compute.server_external_events [req-26a818cd-9a76-4f74-a3fc-b52f4e9533f1 req-e64d4553-b7eb-4fba-94be-0a7e883b260c service nova] Creating event network-changed:ab88f822-dd8c-4d3c-aaeb-f786c078a662 for instance 0d8c7f9d-ae44-4516-a430-e19cf05cda9f on hv-cinder-81571 Oct 28 09:57:38.664727 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [req-26a818cd-9a76-4f74-a3fc-b52f4e9533f1 req-e64d4553-b7eb-4fba-94be-0a7e883b260c service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031850 Oct 28 09:57:38.665694 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 524/1029] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:57:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:39.555670 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-29cf21e9-53dc-4684-b4b2-bd049343b844 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:39.556744 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-29cf21e9-53dc-4684-b4b2-bd049343b844 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 52d24d67-8434-420c-a2b8-ff0fa019a870] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:39.563775 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-29cf21e9-53dc-4684-b4b2-bd049343b844 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:39.564325 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-29cf21e9-53dc-4684-b4b2-bd049343b844 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:39.565163 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-29cf21e9-53dc-4684-b4b2-bd049343b844 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:39.565554 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-29cf21e9-53dc-4684-b4b2-bd049343b844 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:39.597181 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-29cf21e9-53dc-4684-b4b2-bd049343b844 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045440 Oct 28 09:57:39.602621 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 506/1030] 10.222.0.104 () {58 vars in 1306 bytes} [Thu Oct 28 09:57:39 2021] GET /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:57:39.702769 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-7474daba-c233-4852-a005-2c14b3037f74 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1656113095", "imageRef": "623b30fc-1d92-46d9-b556-b9b963f3d76c", "flavorRef": "452", "networks": [{"uuid": "138f56a9-ba13-417d-bda4-3ae273e68e25"}]}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:39.756469 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.network.neutron [None req-7474daba-c233-4852-a005-2c14b3037f74 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] validate_networks() for [('138f56a9-ba13-417d-bda4-3ae273e68e25', None, None, None, None, None)] {{(pid=123069) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 09:57:40.128262 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-7474daba-c233-4852-a005-2c14b3037f74 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Flavor limits 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:57:40.128740 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-7474daba-c233-4852-a005-2c14b3037f74 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Image limits 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:57:40.129212 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-7474daba-c233-4852-a005-2c14b3037f74 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Flavor pref 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:57:40.129622 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-7474daba-c233-4852-a005-2c14b3037f74 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Image pref 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:57:40.130161 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-7474daba-c233-4852-a005-2c14b3037f74 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:57:40.139513 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7474daba-c233-4852-a005-2c14b3037f74 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:40.139997 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7474daba-c233-4852-a005-2c14b3037f74 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:40.140828 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7474daba-c233-4852-a005-2c14b3037f74 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:40.141262 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7474daba-c233-4852-a005-2c14b3037f74 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:40.158529 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.quota [None req-7474daba-c233-4852-a005-2c14b3037f74 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Getting quotas for project b70e48e454564b15803319964d0e32bc. Resources: {'ram', 'cores', 'instances'} {{(pid=123069) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 09:57:40.162621 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.quota [None req-7474daba-c233-4852-a005-2c14b3037f74 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Getting quotas for user fc5490f30a0348bd899c522049f6a528 and project b70e48e454564b15803319964d0e32bc. Resources: {'ram', 'cores', 'instances'} {{(pid=123069) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 09:57:40.174807 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-7474daba-c233-4852-a005-2c14b3037f74 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Going to run 1 instances... {{(pid=123069) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 09:57:40.177295 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-7474daba-c233-4852-a005-2c14b3037f74 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: ea3b0fae-4569-49f1-9c03-ec5fe13e8add] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='623b30fc-1d92-46d9-b556-b9b963f3d76c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 09:57:40.361277 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-7474daba-c233-4852-a005-2c14b3037f74 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.663390 Oct 28 09:57:40.361833 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 525/1031] 10.222.0.104 () {60 vars in 1151 bytes} [Thu Oct 28 09:57:39 2021] POST /compute/v2.1/servers => generated 382 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 28 09:57:40.372611 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-1d946a00-ddae-489f-af0f-d70f817d752f tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:40.373274 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-1d946a00-ddae-489f-af0f-d70f817d752f tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: ea3b0fae-4569-49f1-9c03-ec5fe13e8add] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:40.433247 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-1d946a00-ddae-489f-af0f-d70f817d752f tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:40.443138 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-1d946a00-ddae-489f-af0f-d70f817d752f tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add" status: 200 len: 1222 microversion: 2.1 time: 0.072429 Oct 28 09:57:40.443138 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 507/1032] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:40 2021] GET /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add => generated 1222 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:41.459135 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-e26021ce-5a04-41aa-a668-6aa998c6b42b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:41.459918 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-e26021ce-5a04-41aa-a668-6aa998c6b42b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: ea3b0fae-4569-49f1-9c03-ec5fe13e8add] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:41.466514 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e26021ce-5a04-41aa-a668-6aa998c6b42b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:41.466954 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e26021ce-5a04-41aa-a668-6aa998c6b42b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:41.467728 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e26021ce-5a04-41aa-a668-6aa998c6b42b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:41.468148 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e26021ce-5a04-41aa-a668-6aa998c6b42b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:41.533741 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-e26021ce-5a04-41aa-a668-6aa998c6b42b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:41.541005 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-e26021ce-5a04-41aa-a668-6aa998c6b42b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add" status: 200 len: 1226 microversion: 2.1 time: 0.086581 Oct 28 09:57:41.541564 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 526/1033] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:41 2021] GET /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:42.559673 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-c168ae37-9c6b-4292-a16d-7e0e7e641176 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:42.560345 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-c168ae37-9c6b-4292-a16d-7e0e7e641176 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: ea3b0fae-4569-49f1-9c03-ec5fe13e8add] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:42.567118 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c168ae37-9c6b-4292-a16d-7e0e7e641176 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:42.567567 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c168ae37-9c6b-4292-a16d-7e0e7e641176 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:42.568562 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c168ae37-9c6b-4292-a16d-7e0e7e641176 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:42.569030 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c168ae37-9c6b-4292-a16d-7e0e7e641176 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:42.631753 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-c168ae37-9c6b-4292-a16d-7e0e7e641176 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:42.643727 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-c168ae37-9c6b-4292-a16d-7e0e7e641176 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add" status: 200 len: 1282 microversion: 2.1 time: 0.087768 Oct 28 09:57:42.644641 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 508/1034] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:42 2021] GET /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add => generated 1282 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:43.680103 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-055ece15-9be3-499f-ba26-7a1ec1c943cd tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:43.680750 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-055ece15-9be3-499f-ba26-7a1ec1c943cd tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: ea3b0fae-4569-49f1-9c03-ec5fe13e8add] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:43.687600 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-055ece15-9be3-499f-ba26-7a1ec1c943cd tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:43.689882 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-055ece15-9be3-499f-ba26-7a1ec1c943cd tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:43.689882 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-055ece15-9be3-499f-ba26-7a1ec1c943cd tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:43.689882 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-055ece15-9be3-499f-ba26-7a1ec1c943cd tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:43.838261 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-055ece15-9be3-499f-ba26-7a1ec1c943cd tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:43.847177 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-055ece15-9be3-499f-ba26-7a1ec1c943cd tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add" status: 200 len: 1322 microversion: 2.1 time: 0.176617 Oct 28 09:57:43.847763 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 527/1035] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:43 2021] GET /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:44.339941 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-4bd3f84b-e701-437a-b02e-e6949f637997 req-e6d7d4b8-2d56-42d9-9d58-7482da39d213 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea3b0fae-4569-49f1-9c03-ec5fe13e8add", "tag": "17215c74-4297-4bd4-b82e-c6b8dab5f1da"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:44.339941 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:57:44.339941 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:57:44.351434 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-4bd3f84b-e701-437a-b02e-e6949f637997 req-e6d7d4b8-2d56-42d9-9d58-7482da39d213 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:44.352135 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-4bd3f84b-e701-437a-b02e-e6949f637997 req-e6d7d4b8-2d56-42d9-9d58-7482da39d213 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:44.372637 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-4bd3f84b-e701-437a-b02e-e6949f637997 req-e6d7d4b8-2d56-42d9-9d58-7482da39d213 service nova] Creating event network-changed:17215c74-4297-4bd4-b82e-c6b8dab5f1da for instance ea3b0fae-4569-49f1-9c03-ec5fe13e8add on hv-cinder-81571 Oct 28 09:57:44.381684 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-4bd3f84b-e701-437a-b02e-e6949f637997 req-e6d7d4b8-2d56-42d9-9d58-7482da39d213 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053938 Oct 28 09:57:44.382722 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 509/1036] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:57:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:57:44.865069 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-4b79b9be-f5cc-4223-b883-76c6bd86b231 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:44.865778 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-4b79b9be-f5cc-4223-b883-76c6bd86b231 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: ea3b0fae-4569-49f1-9c03-ec5fe13e8add] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:44.873021 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4b79b9be-f5cc-4223-b883-76c6bd86b231 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:44.873456 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4b79b9be-f5cc-4223-b883-76c6bd86b231 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:44.874237 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4b79b9be-f5cc-4223-b883-76c6bd86b231 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:44.874663 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4b79b9be-f5cc-4223-b883-76c6bd86b231 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:45.004818 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-4b79b9be-f5cc-4223-b883-76c6bd86b231 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:45.012751 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-4b79b9be-f5cc-4223-b883-76c6bd86b231 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add" status: 200 len: 1322 microversion: 2.1 time: 0.152140 Oct 28 09:57:45.013320 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 528/1037] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:44 2021] GET /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:46.030765 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-167c87e9-9ce4-4f7f-ae43-d96eee970e57 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:46.031462 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-167c87e9-9ce4-4f7f-ae43-d96eee970e57 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: ea3b0fae-4569-49f1-9c03-ec5fe13e8add] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:46.038690 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-167c87e9-9ce4-4f7f-ae43-d96eee970e57 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:46.039140 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-167c87e9-9ce4-4f7f-ae43-d96eee970e57 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:46.039927 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-167c87e9-9ce4-4f7f-ae43-d96eee970e57 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:46.040355 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-167c87e9-9ce4-4f7f-ae43-d96eee970e57 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:46.180918 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-167c87e9-9ce4-4f7f-ae43-d96eee970e57 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:46.192826 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-167c87e9-9ce4-4f7f-ae43-d96eee970e57 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add" status: 200 len: 1322 microversion: 2.1 time: 0.166607 Oct 28 09:57:46.193406 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 510/1038] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:46 2021] GET /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:47.210230 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-5b2cea4d-1a8d-4aa3-8c4f-a11f93ddba26 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:47.210877 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-5b2cea4d-1a8d-4aa3-8c4f-a11f93ddba26 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: ea3b0fae-4569-49f1-9c03-ec5fe13e8add] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:47.217295 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5b2cea4d-1a8d-4aa3-8c4f-a11f93ddba26 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:47.217732 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5b2cea4d-1a8d-4aa3-8c4f-a11f93ddba26 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:47.218508 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5b2cea4d-1a8d-4aa3-8c4f-a11f93ddba26 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:47.218936 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5b2cea4d-1a8d-4aa3-8c4f-a11f93ddba26 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:47.349236 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-5b2cea4d-1a8d-4aa3-8c4f-a11f93ddba26 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:47.357707 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-5b2cea4d-1a8d-4aa3-8c4f-a11f93ddba26 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add" status: 200 len: 1322 microversion: 2.1 time: 0.151198 Oct 28 09:57:47.358295 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 529/1039] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:47 2021] GET /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:48.375470 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-2b2568f2-7478-4851-9850-a88b94900da4 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:48.376024 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-2b2568f2-7478-4851-9850-a88b94900da4 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: ea3b0fae-4569-49f1-9c03-ec5fe13e8add] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:48.382783 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2b2568f2-7478-4851-9850-a88b94900da4 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:48.383213 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2b2568f2-7478-4851-9850-a88b94900da4 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:48.383993 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2b2568f2-7478-4851-9850-a88b94900da4 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:48.384420 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2b2568f2-7478-4851-9850-a88b94900da4 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:48.525012 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-2b2568f2-7478-4851-9850-a88b94900da4 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:48.532852 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-2b2568f2-7478-4851-9850-a88b94900da4 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add" status: 200 len: 1322 microversion: 2.1 time: 0.161472 Oct 28 09:57:48.533424 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 511/1040] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:48 2021] GET /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:49.550759 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-5e6040cd-9179-4eba-a724-2658ba85c7bf tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:49.698534 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-5e6040cd-9179-4eba-a724-2658ba85c7bf tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: ea3b0fae-4569-49f1-9c03-ec5fe13e8add] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:49.698534 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5e6040cd-9179-4eba-a724-2658ba85c7bf tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:49.698534 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5e6040cd-9179-4eba-a724-2658ba85c7bf tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:49.698534 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5e6040cd-9179-4eba-a724-2658ba85c7bf tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:49.700023 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5e6040cd-9179-4eba-a724-2658ba85c7bf tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:49.708101 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-5e6040cd-9179-4eba-a724-2658ba85c7bf tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:49.717022 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-5e6040cd-9179-4eba-a724-2658ba85c7bf tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add" status: 200 len: 1322 microversion: 2.1 time: 0.169889 Oct 28 09:57:49.717603 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 530/1041] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:49 2021] GET /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:49.939109 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-b2eaf301-586f-4af4-941f-1904ba5f752b req-93b54af3-f2ac-4d34-88e1-66b7a7206219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea3b0fae-4569-49f1-9c03-ec5fe13e8add", "name": "network-vif-plugged", "status": "completed", "tag": "17215c74-4297-4bd4-b82e-c6b8dab5f1da"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:49.949303 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:57:49.949303 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:57:49.952471 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-b2eaf301-586f-4af4-941f-1904ba5f752b req-93b54af3-f2ac-4d34-88e1-66b7a7206219 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:49.952972 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-b2eaf301-586f-4af4-941f-1904ba5f752b req-93b54af3-f2ac-4d34-88e1-66b7a7206219 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:49.963713 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-b2eaf301-586f-4af4-941f-1904ba5f752b req-93b54af3-f2ac-4d34-88e1-66b7a7206219 service nova] Creating event network-vif-plugged:17215c74-4297-4bd4-b82e-c6b8dab5f1da for instance ea3b0fae-4569-49f1-9c03-ec5fe13e8add on hv-cinder-81571 Oct 28 09:57:49.968729 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-b2eaf301-586f-4af4-941f-1904ba5f752b req-93b54af3-f2ac-4d34-88e1-66b7a7206219 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033278 Oct 28 09:57:49.969333 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 512/1042] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:57:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:50.734453 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-a331a8f9-751b-408b-adda-7a6937ff3e58 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:50.735081 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-a331a8f9-751b-408b-adda-7a6937ff3e58 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: ea3b0fae-4569-49f1-9c03-ec5fe13e8add] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:50.742024 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a331a8f9-751b-408b-adda-7a6937ff3e58 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:50.742469 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a331a8f9-751b-408b-adda-7a6937ff3e58 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:50.743240 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a331a8f9-751b-408b-adda-7a6937ff3e58 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:50.743671 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a331a8f9-751b-408b-adda-7a6937ff3e58 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:50.876906 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-a331a8f9-751b-408b-adda-7a6937ff3e58 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:50.884335 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-a331a8f9-751b-408b-adda-7a6937ff3e58 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add" status: 200 len: 1322 microversion: 2.1 time: 0.153865 Oct 28 09:57:50.884918 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 531/1043] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:50 2021] GET /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:51.903965 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-48a16a3f-8858-4eae-bd93-f742774614c6 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:51.904595 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-48a16a3f-8858-4eae-bd93-f742774614c6 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: ea3b0fae-4569-49f1-9c03-ec5fe13e8add] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:51.910998 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-48a16a3f-8858-4eae-bd93-f742774614c6 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:51.911445 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-48a16a3f-8858-4eae-bd93-f742774614c6 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:51.912222 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-48a16a3f-8858-4eae-bd93-f742774614c6 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:51.912646 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-48a16a3f-8858-4eae-bd93-f742774614c6 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:52.040435 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-48a16a3f-8858-4eae-bd93-f742774614c6 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:52.048123 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-48a16a3f-8858-4eae-bd93-f742774614c6 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add" status: 200 len: 1513 microversion: 2.1 time: 0.149548 Oct 28 09:57:52.048722 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 513/1044] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:57:51 2021] GET /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:53.736828 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-7ec38c37-61b2-4d0f-abdf-007188a4bef2 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "408c5e30-ae55-4ade-9521-8bcc471efa47"}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:53.737956 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-7ec38c37-61b2-4d0f-abdf-007188a4bef2 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: ea3b0fae-4569-49f1-9c03-ec5fe13e8add] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:57:53.744333 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7ec38c37-61b2-4d0f-abdf-007188a4bef2 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:53.745301 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7ec38c37-61b2-4d0f-abdf-007188a4bef2 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:53.746311 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7ec38c37-61b2-4d0f-abdf-007188a4bef2 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:57:53.746733 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7ec38c37-61b2-4d0f-abdf-007188a4bef2 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:57:54.706180 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-7ec38c37-61b2-4d0f-abdf-007188a4bef2 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "POST /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.972971 Oct 28 09:57:54.707041 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 532/1045] 10.222.0.104 () {60 vars in 1327 bytes} [Thu Oct 28 09:57:53 2021] POST /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add/os-volume_attachments => generated 194 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:58:02.326440 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-48347727-9145-4f97-abad-68ff56c845fa tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:02.327093 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-48347727-9145-4f97-abad-68ff56c845fa tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: ea3b0fae-4569-49f1-9c03-ec5fe13e8add] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:58:02.335202 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-48347727-9145-4f97-abad-68ff56c845fa tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:02.335646 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-48347727-9145-4f97-abad-68ff56c845fa tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:02.336430 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-48347727-9145-4f97-abad-68ff56c845fa tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:02.336907 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-48347727-9145-4f97-abad-68ff56c845fa tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:02.422065 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.objects.instance [None req-48347727-9145-4f97-abad-68ff56c845fa tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lazy-loading 'services' on Instance uuid ea3b0fae-4569-49f1-9c03-ec5fe13e8add {{(pid=123068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 09:58:02.622200 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-48347727-9145-4f97-abad-68ff56c845fa tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "DELETE /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add/os-volume_attachments/408c5e30-ae55-4ade-9521-8bcc471efa47" status: 202 len: 0 microversion: 2.1 time: 0.298891 Oct 28 09:58:02.623548 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 514/1046] 10.222.0.104 () {58 vars in 1420 bytes} [Thu Oct 28 09:58:02 2021] DELETE /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add/os-volume_attachments/408c5e30-ae55-4ade-9521-8bcc471efa47 => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:58:02.632917 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-40b7bcaf-5b36-4e2e-8530-19ee13528cb8 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:02.634023 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-40b7bcaf-5b36-4e2e-8530-19ee13528cb8 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: ea3b0fae-4569-49f1-9c03-ec5fe13e8add] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:58:02.642991 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-40b7bcaf-5b36-4e2e-8530-19ee13528cb8 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:02.643436 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-40b7bcaf-5b36-4e2e-8530-19ee13528cb8 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:02.644302 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-40b7bcaf-5b36-4e2e-8530-19ee13528cb8 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:02.644700 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-40b7bcaf-5b36-4e2e-8530-19ee13528cb8 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:02.688487 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-40b7bcaf-5b36-4e2e-8530-19ee13528cb8 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059535 Oct 28 09:58:02.689329 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 533/1047] 10.222.0.104 () {58 vars in 1306 bytes} [Thu Oct 28 09:58:02 2021] GET /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:58:03.703697 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-067e54b6-0d1c-40fa-9de7-1974405ea6bd tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:03.708594 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-067e54b6-0d1c-40fa-9de7-1974405ea6bd tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: ea3b0fae-4569-49f1-9c03-ec5fe13e8add] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:58:03.711437 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-067e54b6-0d1c-40fa-9de7-1974405ea6bd tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:03.711883 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-067e54b6-0d1c-40fa-9de7-1974405ea6bd tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:03.712681 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-067e54b6-0d1c-40fa-9de7-1974405ea6bd tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:03.713132 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-067e54b6-0d1c-40fa-9de7-1974405ea6bd tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:03.745382 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-067e54b6-0d1c-40fa-9de7-1974405ea6bd tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046978 Oct 28 09:58:03.746220 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 515/1048] 10.222.0.104 () {58 vars in 1306 bytes} [Thu Oct 28 09:58:03 2021] GET /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:58:04.758385 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-c8203e54-6690-4847-95c5-903592ef526c tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:04.759308 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-c8203e54-6690-4847-95c5-903592ef526c tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: ea3b0fae-4569-49f1-9c03-ec5fe13e8add] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:58:04.766013 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c8203e54-6690-4847-95c5-903592ef526c tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:04.766458 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c8203e54-6690-4847-95c5-903592ef526c tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:04.767265 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c8203e54-6690-4847-95c5-903592ef526c tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:04.767700 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c8203e54-6690-4847-95c5-903592ef526c tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:04.797225 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-c8203e54-6690-4847-95c5-903592ef526c tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042726 Oct 28 09:58:04.797785 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 534/1049] 10.222.0.104 () {58 vars in 1306 bytes} [Thu Oct 28 09:58:04 2021] GET /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:58:06.152336 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-e3a1269c-14ec-403d-abea-d5117b605c68 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:06.152922 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-e3a1269c-14ec-403d-abea-d5117b605c68 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: ea3b0fae-4569-49f1-9c03-ec5fe13e8add] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:58:06.159790 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e3a1269c-14ec-403d-abea-d5117b605c68 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:06.160238 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e3a1269c-14ec-403d-abea-d5117b605c68 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:06.161089 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e3a1269c-14ec-403d-abea-d5117b605c68 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:06.161523 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e3a1269c-14ec-403d-abea-d5117b605c68 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:06.189415 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-e3a1269c-14ec-403d-abea-d5117b605c68 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: ea3b0fae-4569-49f1-9c03-ec5fe13e8add] Going to try to terminate instance {{(pid=123068) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 09:58:06.593261 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-e3a1269c-14ec-403d-abea-d5117b605c68 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "DELETE /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add" status: 204 len: 0 microversion: 2.1 time: 0.443945 Oct 28 09:58:06.593861 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 516/1050] 10.222.0.104 () {58 vars in 1243 bytes} [Thu Oct 28 09:58:06 2021] DELETE /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 09:58:06.601902 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-f550eb8e-54a0-41c2-b83a-6ab45bd91476 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:06.602512 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-f550eb8e-54a0-41c2-b83a-6ab45bd91476 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: ea3b0fae-4569-49f1-9c03-ec5fe13e8add] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:58:06.609819 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f550eb8e-54a0-41c2-b83a-6ab45bd91476 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:06.610421 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f550eb8e-54a0-41c2-b83a-6ab45bd91476 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:06.611097 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f550eb8e-54a0-41c2-b83a-6ab45bd91476 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:06.611603 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f550eb8e-54a0-41c2-b83a-6ab45bd91476 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:06.739046 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-f550eb8e-54a0-41c2-b83a-6ab45bd91476 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:06.746773 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-f550eb8e-54a0-41c2-b83a-6ab45bd91476 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add" status: 200 len: 1519 microversion: 2.1 time: 0.148665 Oct 28 09:58:06.747337 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 535/1051] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:58:06 2021] GET /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:07.765537 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-4ca87deb-9ab5-4d43-82d8-77a11fc2003b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:07.766241 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-4ca87deb-9ab5-4d43-82d8-77a11fc2003b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: ea3b0fae-4569-49f1-9c03-ec5fe13e8add] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:58:07.777330 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4ca87deb-9ab5-4d43-82d8-77a11fc2003b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:07.778145 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4ca87deb-9ab5-4d43-82d8-77a11fc2003b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:07.780208 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4ca87deb-9ab5-4d43-82d8-77a11fc2003b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:07.781039 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4ca87deb-9ab5-4d43-82d8-77a11fc2003b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:07.939786 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-4ca87deb-9ab5-4d43-82d8-77a11fc2003b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:07.947681 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-4ca87deb-9ab5-4d43-82d8-77a11fc2003b tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add" status: 200 len: 1519 microversion: 2.1 time: 0.187395 Oct 28 09:58:07.948261 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 517/1052] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:58:07 2021] GET /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add => generated 1519 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:08.971059 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-af671c9e-3577-4023-8a79-1af0f2acb22c tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:08.971735 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-af671c9e-3577-4023-8a79-1af0f2acb22c tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: ea3b0fae-4569-49f1-9c03-ec5fe13e8add] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:58:08.978865 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-af671c9e-3577-4023-8a79-1af0f2acb22c tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:08.979751 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-af671c9e-3577-4023-8a79-1af0f2acb22c tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:08.980448 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-af671c9e-3577-4023-8a79-1af0f2acb22c tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:08.981082 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-af671c9e-3577-4023-8a79-1af0f2acb22c tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:09.009764 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-87419c4a-703b-403e-80a5-1cf58d0a77e8 req-eff13fb6-0b40-44ea-9fee-f579d4905110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea3b0fae-4569-49f1-9c03-ec5fe13e8add", "name": "network-vif-deleted", "tag": "17215c74-4297-4bd4-b82e-c6b8dab5f1da"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:58:09.013300 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:58:09.013300 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:58:09.024965 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-87419c4a-703b-403e-80a5-1cf58d0a77e8 req-eff13fb6-0b40-44ea-9fee-f579d4905110 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:09.025821 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-87419c4a-703b-403e-80a5-1cf58d0a77e8 req-eff13fb6-0b40-44ea-9fee-f579d4905110 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:09.039430 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-87419c4a-703b-403e-80a5-1cf58d0a77e8 req-eff13fb6-0b40-44ea-9fee-f579d4905110 service nova] Creating event network-vif-deleted:17215c74-4297-4bd4-b82e-c6b8dab5f1da for instance ea3b0fae-4569-49f1-9c03-ec5fe13e8add on hv-cinder-81571 Oct 28 09:58:09.045206 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-87419c4a-703b-403e-80a5-1cf58d0a77e8 req-eff13fb6-0b40-44ea-9fee-f579d4905110 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039151 Oct 28 09:58:09.046552 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 518/1053] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:58:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:58:09.059860 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-af671c9e-3577-4023-8a79-1af0f2acb22c tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:09.070706 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-af671c9e-3577-4023-8a79-1af0f2acb22c tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add" status: 200 len: 1477 microversion: 2.1 time: 0.107071 Oct 28 09:58:09.071599 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 536/1054] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:58:08 2021] GET /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add => generated 1477 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:58:10.090509 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-3d6023e2-60fd-4fce-a635-2a8d3ca58fe9 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:10.091224 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-3d6023e2-60fd-4fce-a635-2a8d3ca58fe9 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: ea3b0fae-4569-49f1-9c03-ec5fe13e8add] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:58:10.098319 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3d6023e2-60fd-4fce-a635-2a8d3ca58fe9 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:10.098762 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3d6023e2-60fd-4fce-a635-2a8d3ca58fe9 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:10.099562 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3d6023e2-60fd-4fce-a635-2a8d3ca58fe9 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:10.099995 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3d6023e2-60fd-4fce-a635-2a8d3ca58fe9 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:10.115685 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.wsgi [None req-3d6023e2-60fd-4fce-a635-2a8d3ca58fe9 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] HTTP exception thrown: Instance ea3b0fae-4569-49f1-9c03-ec5fe13e8add could not be found. Oct 28 09:58:10.118948 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-3d6023e2-60fd-4fce-a635-2a8d3ca58fe9 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Returning 404 to user: Instance ea3b0fae-4569-49f1-9c03-ec5fe13e8add could not be found. {{(pid=123068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:58:10.118948 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-3d6023e2-60fd-4fce-a635-2a8d3ca58fe9 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add" status: 404 len: 111 microversion: 2.1 time: 0.031304 Oct 28 09:58:10.118948 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 519/1055] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:58:10 2021] GET /compute/v2.1/servers/ea3b0fae-4569-49f1-9c03-ec5fe13e8add => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:58:11.460664 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-0c3e2e2a-c131-489b-aaa4-a504cec938c3 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:11.461251 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-0c3e2e2a-c131-489b-aaa4-a504cec938c3 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 52d24d67-8434-420c-a2b8-ff0fa019a870] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:58:11.467773 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0c3e2e2a-c131-489b-aaa4-a504cec938c3 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:11.468206 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0c3e2e2a-c131-489b-aaa4-a504cec938c3 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:11.469001 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0c3e2e2a-c131-489b-aaa4-a504cec938c3 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:11.469431 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0c3e2e2a-c131-489b-aaa4-a504cec938c3 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:11.496353 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-0c3e2e2a-c131-489b-aaa4-a504cec938c3 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 52d24d67-8434-420c-a2b8-ff0fa019a870] Going to try to terminate instance {{(pid=123069) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 09:58:11.781488 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-0c3e2e2a-c131-489b-aaa4-a504cec938c3 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "DELETE /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870" status: 204 len: 0 microversion: 2.1 time: 0.325002 Oct 28 09:58:11.781997 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 537/1056] 10.222.0.104 () {58 vars in 1243 bytes} [Thu Oct 28 09:58:11 2021] DELETE /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:58:11.789987 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-e86b5386-c748-4bf6-9b49-4dd787d89111 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:11.790576 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-e86b5386-c748-4bf6-9b49-4dd787d89111 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 52d24d67-8434-420c-a2b8-ff0fa019a870] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:58:11.797946 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e86b5386-c748-4bf6-9b49-4dd787d89111 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:11.798400 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e86b5386-c748-4bf6-9b49-4dd787d89111 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:11.799162 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e86b5386-c748-4bf6-9b49-4dd787d89111 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:11.799589 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e86b5386-c748-4bf6-9b49-4dd787d89111 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:11.948114 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-e86b5386-c748-4bf6-9b49-4dd787d89111 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:11.956778 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-e86b5386-c748-4bf6-9b49-4dd787d89111 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870" status: 200 len: 1518 microversion: 2.1 time: 0.170416 Oct 28 09:58:11.957375 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 520/1057] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:58:11 2021] GET /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870 => generated 1518 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:12.974624 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-a553a613-8530-4b48-85ec-b55beff01eba tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:12.975485 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-a553a613-8530-4b48-85ec-b55beff01eba tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 52d24d67-8434-420c-a2b8-ff0fa019a870] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:58:12.983853 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a553a613-8530-4b48-85ec-b55beff01eba tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:12.984317 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a553a613-8530-4b48-85ec-b55beff01eba tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:12.985146 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a553a613-8530-4b48-85ec-b55beff01eba tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:12.985586 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-a553a613-8530-4b48-85ec-b55beff01eba tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:13.147991 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-a553a613-8530-4b48-85ec-b55beff01eba tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:13.156710 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-a553a613-8530-4b48-85ec-b55beff01eba tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870" status: 200 len: 1518 microversion: 2.1 time: 0.186175 Oct 28 09:58:13.157311 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 538/1058] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:58:12 2021] GET /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870 => generated 1518 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:14.080446 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-5166d77c-15e5-45a9-82cb-50ceb03d0a59 req-3f42a2f0-a73d-4db5-a12c-95ad82134783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d24d67-8434-420c-a2b8-ff0fa019a870", "name": "network-vif-deleted", "tag": "0bed67f6-e6ea-496f-9c92-15d0b605ebff"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:58:14.082523 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:58:14.082523 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:58:14.090050 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-5166d77c-15e5-45a9-82cb-50ceb03d0a59 req-3f42a2f0-a73d-4db5-a12c-95ad82134783 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:14.090489 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-5166d77c-15e5-45a9-82cb-50ceb03d0a59 req-3f42a2f0-a73d-4db5-a12c-95ad82134783 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:14.102737 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-5166d77c-15e5-45a9-82cb-50ceb03d0a59 req-3f42a2f0-a73d-4db5-a12c-95ad82134783 service nova] Creating event network-vif-deleted:0bed67f6-e6ea-496f-9c92-15d0b605ebff for instance 52d24d67-8434-420c-a2b8-ff0fa019a870 on hv-cinder-81571 Oct 28 09:58:14.109044 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-5166d77c-15e5-45a9-82cb-50ceb03d0a59 req-3f42a2f0-a73d-4db5-a12c-95ad82134783 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033800 Oct 28 09:58:14.109670 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 521/1059] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:58:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:58:14.186772 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-cede67bc-8c4d-4b08-8c44-7de5fa492cc0 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:14.188323 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-cede67bc-8c4d-4b08-8c44-7de5fa492cc0 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 52d24d67-8434-420c-a2b8-ff0fa019a870] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:58:14.196053 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-cede67bc-8c4d-4b08-8c44-7de5fa492cc0 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:14.196591 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-cede67bc-8c4d-4b08-8c44-7de5fa492cc0 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:14.197494 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-cede67bc-8c4d-4b08-8c44-7de5fa492cc0 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:14.198132 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-cede67bc-8c4d-4b08-8c44-7de5fa492cc0 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:14.262832 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-cede67bc-8c4d-4b08-8c44-7de5fa492cc0 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:14.272086 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-cede67bc-8c4d-4b08-8c44-7de5fa492cc0 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870" status: 200 len: 1476 microversion: 2.1 time: 0.094058 Oct 28 09:58:14.272713 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 539/1060] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:58:14 2021] GET /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870 => generated 1476 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:15.290103 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-ad55ee02-44b5-4ae8-8f61-7b7055a3f141 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:15.290807 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-ad55ee02-44b5-4ae8-8f61-7b7055a3f141 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 52d24d67-8434-420c-a2b8-ff0fa019a870] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:58:15.298174 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ad55ee02-44b5-4ae8-8f61-7b7055a3f141 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:15.298628 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ad55ee02-44b5-4ae8-8f61-7b7055a3f141 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:15.299516 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ad55ee02-44b5-4ae8-8f61-7b7055a3f141 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:15.299952 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ad55ee02-44b5-4ae8-8f61-7b7055a3f141 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:15.315638 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.wsgi [None req-ad55ee02-44b5-4ae8-8f61-7b7055a3f141 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] HTTP exception thrown: Instance 52d24d67-8434-420c-a2b8-ff0fa019a870 could not be found. Oct 28 09:58:15.316325 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-ad55ee02-44b5-4ae8-8f61-7b7055a3f141 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Returning 404 to user: Instance 52d24d67-8434-420c-a2b8-ff0fa019a870 could not be found. {{(pid=123068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:58:15.317212 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-ad55ee02-44b5-4ae8-8f61-7b7055a3f141 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870" status: 404 len: 111 microversion: 2.1 time: 0.032043 Oct 28 09:58:15.317846 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 522/1061] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:58:15 2021] GET /compute/v2.1/servers/52d24d67-8434-420c-a2b8-ff0fa019a870 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:58:15.325853 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-10d78890-67c0-43c1-925f-7e411e588f1a tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:15.328060 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-10d78890-67c0-43c1-925f-7e411e588f1a tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 694199a8-e0fe-4c60-87ff-77409ae17040] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:58:15.335165 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-10d78890-67c0-43c1-925f-7e411e588f1a tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:15.335605 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-10d78890-67c0-43c1-925f-7e411e588f1a tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:15.336373 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-10d78890-67c0-43c1-925f-7e411e588f1a tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:15.336829 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-10d78890-67c0-43c1-925f-7e411e588f1a tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:15.367433 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-10d78890-67c0-43c1-925f-7e411e588f1a tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 694199a8-e0fe-4c60-87ff-77409ae17040] Going to try to terminate instance {{(pid=123069) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 09:58:15.666645 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-10d78890-67c0-43c1-925f-7e411e588f1a tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "DELETE /compute/v2.1/servers/694199a8-e0fe-4c60-87ff-77409ae17040" status: 204 len: 0 microversion: 2.1 time: 0.344140 Oct 28 09:58:15.667260 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 540/1062] 10.222.0.104 () {58 vars in 1243 bytes} [Thu Oct 28 09:58:15 2021] DELETE /compute/v2.1/servers/694199a8-e0fe-4c60-87ff-77409ae17040 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:58:15.676017 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-3100ddb9-4591-444a-afd3-4f8e9ea0c1e1 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:15.676630 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-3100ddb9-4591-444a-afd3-4f8e9ea0c1e1 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 694199a8-e0fe-4c60-87ff-77409ae17040] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:58:15.682776 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3100ddb9-4591-444a-afd3-4f8e9ea0c1e1 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:15.683212 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3100ddb9-4591-444a-afd3-4f8e9ea0c1e1 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:15.683987 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3100ddb9-4591-444a-afd3-4f8e9ea0c1e1 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:15.684407 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-3100ddb9-4591-444a-afd3-4f8e9ea0c1e1 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:15.835170 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-3100ddb9-4591-444a-afd3-4f8e9ea0c1e1 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:15.847428 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-3100ddb9-4591-444a-afd3-4f8e9ea0c1e1 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/694199a8-e0fe-4c60-87ff-77409ae17040" status: 200 len: 1517 microversion: 2.1 time: 0.175104 Oct 28 09:58:15.848433 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 523/1063] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:58:15 2021] GET /compute/v2.1/servers/694199a8-e0fe-4c60-87ff-77409ae17040 => generated 1517 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:16.872368 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-520ff586-9b99-49e8-9394-1ba7712d604e tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:16.873837 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-520ff586-9b99-49e8-9394-1ba7712d604e tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 694199a8-e0fe-4c60-87ff-77409ae17040] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:58:16.880422 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-520ff586-9b99-49e8-9394-1ba7712d604e tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:16.880896 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-520ff586-9b99-49e8-9394-1ba7712d604e tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:16.881686 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-520ff586-9b99-49e8-9394-1ba7712d604e tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:16.882113 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-520ff586-9b99-49e8-9394-1ba7712d604e tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:17.020563 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-520ff586-9b99-49e8-9394-1ba7712d604e tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:17.028477 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-520ff586-9b99-49e8-9394-1ba7712d604e tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/694199a8-e0fe-4c60-87ff-77409ae17040" status: 200 len: 1517 microversion: 2.1 time: 0.160666 Oct 28 09:58:17.029145 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 541/1064] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:58:16 2021] GET /compute/v2.1/servers/694199a8-e0fe-4c60-87ff-77409ae17040 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:17.827967 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-c03353a0-90f1-4653-a494-2e9f4d39f081 req-595d95c9-d2bf-49cc-9635-f5efc58b2548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "694199a8-e0fe-4c60-87ff-77409ae17040", "name": "network-vif-deleted", "tag": "a4980d72-c568-47e2-86cf-4feeb9e706c7"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:58:17.829678 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:58:17.829678 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:58:17.837463 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-c03353a0-90f1-4653-a494-2e9f4d39f081 req-595d95c9-d2bf-49cc-9635-f5efc58b2548 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:17.837898 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-c03353a0-90f1-4653-a494-2e9f4d39f081 req-595d95c9-d2bf-49cc-9635-f5efc58b2548 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:17.853010 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-c03353a0-90f1-4653-a494-2e9f4d39f081 req-595d95c9-d2bf-49cc-9635-f5efc58b2548 service nova] Creating event network-vif-deleted:a4980d72-c568-47e2-86cf-4feeb9e706c7 for instance 694199a8-e0fe-4c60-87ff-77409ae17040 on hv-cinder-81571 Oct 28 09:58:17.858538 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-c03353a0-90f1-4653-a494-2e9f4d39f081 req-595d95c9-d2bf-49cc-9635-f5efc58b2548 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035546 Oct 28 09:58:17.859154 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 524/1065] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:58:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:58:18.047442 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-49a731a4-5228-47a0-b419-f5b952f18f37 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:18.048090 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-49a731a4-5228-47a0-b419-f5b952f18f37 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 694199a8-e0fe-4c60-87ff-77409ae17040] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:58:18.055889 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-49a731a4-5228-47a0-b419-f5b952f18f37 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:18.056842 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-49a731a4-5228-47a0-b419-f5b952f18f37 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:18.058187 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-49a731a4-5228-47a0-b419-f5b952f18f37 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:18.058941 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-49a731a4-5228-47a0-b419-f5b952f18f37 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:18.149484 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-49a731a4-5228-47a0-b419-f5b952f18f37 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:18.159445 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-49a731a4-5228-47a0-b419-f5b952f18f37 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/694199a8-e0fe-4c60-87ff-77409ae17040" status: 200 len: 1306 microversion: 2.1 time: 0.116095 Oct 28 09:58:18.160240 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 542/1066] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:58:18 2021] GET /compute/v2.1/servers/694199a8-e0fe-4c60-87ff-77409ae17040 => generated 1306 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:19.183478 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-d2403f83-09b1-4914-b0f8-b48827a9a0fa tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:19.184838 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-d2403f83-09b1-4914-b0f8-b48827a9a0fa tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 694199a8-e0fe-4c60-87ff-77409ae17040] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:58:19.196312 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d2403f83-09b1-4914-b0f8-b48827a9a0fa tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:19.197184 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d2403f83-09b1-4914-b0f8-b48827a9a0fa tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:19.198647 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d2403f83-09b1-4914-b0f8-b48827a9a0fa tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:19.199461 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d2403f83-09b1-4914-b0f8-b48827a9a0fa tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:19.228273 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.wsgi [None req-d2403f83-09b1-4914-b0f8-b48827a9a0fa tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] HTTP exception thrown: Instance 694199a8-e0fe-4c60-87ff-77409ae17040 could not be found. Oct 28 09:58:19.229358 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-d2403f83-09b1-4914-b0f8-b48827a9a0fa tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Returning 404 to user: Instance 694199a8-e0fe-4c60-87ff-77409ae17040 could not be found. {{(pid=123068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:58:19.230638 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-d2403f83-09b1-4914-b0f8-b48827a9a0fa tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/694199a8-e0fe-4c60-87ff-77409ae17040" status: 404 len: 111 microversion: 2.1 time: 0.055475 Oct 28 09:58:19.231545 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 525/1067] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:58:19 2021] GET /compute/v2.1/servers/694199a8-e0fe-4c60-87ff-77409ae17040 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:58:20.504356 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-6953c3cc-afcc-4d95-be07-48e051226525 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:20.505104 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-6953c3cc-afcc-4d95-be07-48e051226525 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 02a6163e-083b-464d-8650-77d3e421ffa6] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:58:20.514866 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6953c3cc-afcc-4d95-be07-48e051226525 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:20.515310 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6953c3cc-afcc-4d95-be07-48e051226525 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:20.516297 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6953c3cc-afcc-4d95-be07-48e051226525 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:20.516747 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6953c3cc-afcc-4d95-be07-48e051226525 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:20.546622 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-6953c3cc-afcc-4d95-be07-48e051226525 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 02a6163e-083b-464d-8650-77d3e421ffa6] Going to try to terminate instance {{(pid=123069) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 09:58:20.827073 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-6953c3cc-afcc-4d95-be07-48e051226525 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "DELETE /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6" status: 204 len: 0 microversion: 2.1 time: 0.327950 Oct 28 09:58:20.827688 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 543/1068] 10.222.0.104 () {58 vars in 1243 bytes} [Thu Oct 28 09:58:20 2021] DELETE /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:58:20.836218 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-65f9428a-a238-485b-9816-720d6f040810 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:20.836830 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-65f9428a-a238-485b-9816-720d6f040810 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 02a6163e-083b-464d-8650-77d3e421ffa6] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:58:20.843617 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-65f9428a-a238-485b-9816-720d6f040810 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:20.844054 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-65f9428a-a238-485b-9816-720d6f040810 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:20.844865 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-65f9428a-a238-485b-9816-720d6f040810 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:20.845292 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-65f9428a-a238-485b-9816-720d6f040810 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:20.983010 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-65f9428a-a238-485b-9816-720d6f040810 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:20.991103 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-65f9428a-a238-485b-9816-720d6f040810 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6" status: 200 len: 1519 microversion: 2.1 time: 0.159062 Oct 28 09:58:20.991684 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 526/1069] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:58:20 2021] GET /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:22.008671 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-6f074d55-156b-43ce-a3de-e76c30cc7e80 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:22.009394 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-6f074d55-156b-43ce-a3de-e76c30cc7e80 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 02a6163e-083b-464d-8650-77d3e421ffa6] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:58:22.016642 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6f074d55-156b-43ce-a3de-e76c30cc7e80 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:22.017117 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6f074d55-156b-43ce-a3de-e76c30cc7e80 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:22.017912 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6f074d55-156b-43ce-a3de-e76c30cc7e80 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:22.018340 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-6f074d55-156b-43ce-a3de-e76c30cc7e80 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:22.157315 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-6f074d55-156b-43ce-a3de-e76c30cc7e80 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:22.172219 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-6f074d55-156b-43ce-a3de-e76c30cc7e80 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6" status: 200 len: 1519 microversion: 2.1 time: 0.167673 Oct 28 09:58:22.173063 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 544/1070] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:58:22 2021] GET /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6 => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:23.196554 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-b8db2a3a-8940-4f67-86da-60b59fe586b5 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:23.197472 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-b8db2a3a-8940-4f67-86da-60b59fe586b5 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 02a6163e-083b-464d-8650-77d3e421ffa6] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:58:23.209322 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b8db2a3a-8940-4f67-86da-60b59fe586b5 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:23.210056 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b8db2a3a-8940-4f67-86da-60b59fe586b5 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:23.211347 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b8db2a3a-8940-4f67-86da-60b59fe586b5 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:23.212121 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-b8db2a3a-8940-4f67-86da-60b59fe586b5 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:23.229510 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [req-33036785-b2db-44e9-9fca-7405ffc007e0 req-4af40dfa-304e-4331-b292-f5a5799320a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02a6163e-083b-464d-8650-77d3e421ffa6", "name": "network-vif-deleted", "tag": "07e48416-de5b-46f9-b34f-60662f138c23"}]} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:58:23.231240 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:58:23.231240 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 09:58:23.240099 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-33036785-b2db-44e9-9fca-7405ffc007e0 req-4af40dfa-304e-4331-b292-f5a5799320a5 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:23.245253 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-33036785-b2db-44e9-9fca-7405ffc007e0 req-4af40dfa-304e-4331-b292-f5a5799320a5 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:23.253548 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.compute.server_external_events [req-33036785-b2db-44e9-9fca-7405ffc007e0 req-4af40dfa-304e-4331-b292-f5a5799320a5 service nova] Creating event network-vif-deleted:07e48416-de5b-46f9-b34f-60662f138c23 for instance 02a6163e-083b-464d-8650-77d3e421ffa6 on hv-cinder-81571 Oct 28 09:58:23.258919 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [req-33036785-b2db-44e9-9fca-7405ffc007e0 req-4af40dfa-304e-4331-b292-f5a5799320a5 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032983 Oct 28 09:58:23.259758 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 545/1071] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:58:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:58:23.315657 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-b8db2a3a-8940-4f67-86da-60b59fe586b5 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc5490f30a0348bd899c522049f6a528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70e48e454564b15803319964d0e32bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:23.324970 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-b8db2a3a-8940-4f67-86da-60b59fe586b5 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6" status: 200 len: 1477 microversion: 2.1 time: 0.134781 Oct 28 09:58:23.326232 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 527/1072] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:58:23 2021] GET /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6 => generated 1477 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:24.343411 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-7dced735-61b6-409e-84e7-a10f3862a0d0 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:24.344151 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-7dced735-61b6-409e-84e7-a10f3862a0d0 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] [instance: 02a6163e-083b-464d-8650-77d3e421ffa6] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:58:24.350941 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7dced735-61b6-409e-84e7-a10f3862a0d0 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:24.351389 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7dced735-61b6-409e-84e7-a10f3862a0d0 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:24.352184 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7dced735-61b6-409e-84e7-a10f3862a0d0 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:24.352618 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7dced735-61b6-409e-84e7-a10f3862a0d0 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:24.367173 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.wsgi [None req-7dced735-61b6-409e-84e7-a10f3862a0d0 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] HTTP exception thrown: Instance 02a6163e-083b-464d-8650-77d3e421ffa6 could not be found. Oct 28 09:58:24.367779 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-7dced735-61b6-409e-84e7-a10f3862a0d0 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] Returning 404 to user: Instance 02a6163e-083b-464d-8650-77d3e421ffa6 could not be found. {{(pid=123069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:58:24.368624 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-7dced735-61b6-409e-84e7-a10f3862a0d0 tempest-AttachVolumeNegativeTest-1612580897 tempest-AttachVolumeNegativeTest-1612580897-project] 10.222.0.104 "GET /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6" status: 404 len: 111 microversion: 2.1 time: 0.030009 Oct 28 09:58:24.369227 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 546/1073] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:58:24 2021] GET /compute/v2.1/servers/02a6163e-083b-464d-8650-77d3e421ffa6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 09:58:37.063595 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 09:58:37.064642 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: Thu Oct 28 09:58:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 09:58:58.629183 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-a14dd834-3bd2-441c-bd20-4b1faaa32e93 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1926300918", "imageRef": "623b30fc-1d92-46d9-b556-b9b963f3d76c", "flavorRef": "452", "networks": [{"uuid": "205ae73f-5d95-4eea-9d96-d376199c03ff"}]}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:58:58.839317 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.network.neutron [None req-a14dd834-3bd2-441c-bd20-4b1faaa32e93 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] validate_networks() for [('205ae73f-5d95-4eea-9d96-d376199c03ff', None, None, None, None, None)] {{(pid=123068) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 09:58:59.190341 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-a14dd834-3bd2-441c-bd20-4b1faaa32e93 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Flavor limits 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:58:59.190794 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-a14dd834-3bd2-441c-bd20-4b1faaa32e93 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Image limits 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:58:59.191264 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-a14dd834-3bd2-441c-bd20-4b1faaa32e93 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Flavor pref 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:58:59.191689 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-a14dd834-3bd2-441c-bd20-4b1faaa32e93 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Image pref 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:58:59.192099 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-a14dd834-3bd2-441c-bd20-4b1faaa32e93 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:58:59.200606 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a14dd834-3bd2-441c-bd20-4b1faaa32e93 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:59.201080 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a14dd834-3bd2-441c-bd20-4b1faaa32e93 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:59.202484 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a14dd834-3bd2-441c-bd20-4b1faaa32e93 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:58:59.202942 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a14dd834-3bd2-441c-bd20-4b1faaa32e93 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:58:59.220161 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.quota [None req-a14dd834-3bd2-441c-bd20-4b1faaa32e93 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Getting quotas for project 8273ac2aca774a0aa4b6a43247c31c7a. Resources: {'ram', 'cores', 'instances'} {{(pid=123068) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 09:58:59.224136 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.quota [None req-a14dd834-3bd2-441c-bd20-4b1faaa32e93 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Getting quotas for user dbe824ed5ea44570b4127ca6873367c8 and project 8273ac2aca774a0aa4b6a43247c31c7a. Resources: {'ram', 'cores', 'instances'} {{(pid=123068) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 09:58:59.234839 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-a14dd834-3bd2-441c-bd20-4b1faaa32e93 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Going to run 1 instances... {{(pid=123068) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 09:58:59.237201 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-a14dd834-3bd2-441c-bd20-4b1faaa32e93 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: e89c72f4-558a-4f0f-af56-ef337001d531] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='623b30fc-1d92-46d9-b556-b9b963f3d76c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 09:58:59.496215 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-a14dd834-3bd2-441c-bd20-4b1faaa32e93 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.870699 Oct 28 09:58:59.496960 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 528/1074] 10.222.0.104 () {60 vars in 1151 bytes} [Thu Oct 28 09:58:58 2021] POST /compute/v2.1/servers => generated 382 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 28 09:58:59.506971 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-41ace677-17b1-4f7d-bbe8-536483229462 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:59.507622 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-41ace677-17b1-4f7d-bbe8-536483229462 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: e89c72f4-558a-4f0f-af56-ef337001d531] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:58:59.627975 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-41ace677-17b1-4f7d-bbe8-536483229462 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe824ed5ea44570b4127ca6873367c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8273ac2aca774a0aa4b6a43247c31c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:59.635701 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-41ace677-17b1-4f7d-bbe8-536483229462 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "GET /compute/v2.1/servers/e89c72f4-558a-4f0f-af56-ef337001d531" status: 200 len: 1223 microversion: 2.1 time: 0.132429 Oct 28 09:58:59.636345 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 547/1075] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:58:59 2021] GET /compute/v2.1/servers/e89c72f4-558a-4f0f-af56-ef337001d531 => generated 1223 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:00.653592 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-2c88c287-d798-4fe3-a8a0-eabad04bf671 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:00.654324 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-2c88c287-d798-4fe3-a8a0-eabad04bf671 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: e89c72f4-558a-4f0f-af56-ef337001d531] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:59:00.709225 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-2c88c287-d798-4fe3-a8a0-eabad04bf671 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe824ed5ea44570b4127ca6873367c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8273ac2aca774a0aa4b6a43247c31c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:00.716831 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-2c88c287-d798-4fe3-a8a0-eabad04bf671 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "GET /compute/v2.1/servers/e89c72f4-558a-4f0f-af56-ef337001d531" status: 200 len: 1223 microversion: 2.1 time: 0.067791 Oct 28 09:59:00.717399 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 529/1076] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:59:00 2021] GET /compute/v2.1/servers/e89c72f4-558a-4f0f-af56-ef337001d531 => generated 1223 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:01.736459 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-9160f010-59aa-4163-aec4-13928977923d tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:01.737336 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-9160f010-59aa-4163-aec4-13928977923d tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: e89c72f4-558a-4f0f-af56-ef337001d531] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:59:01.744435 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9160f010-59aa-4163-aec4-13928977923d tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:01.744901 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9160f010-59aa-4163-aec4-13928977923d tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:01.745692 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9160f010-59aa-4163-aec4-13928977923d tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:01.746160 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9160f010-59aa-4163-aec4-13928977923d tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:01.809899 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-9160f010-59aa-4163-aec4-13928977923d tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe824ed5ea44570b4127ca6873367c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8273ac2aca774a0aa4b6a43247c31c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:01.817869 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-9160f010-59aa-4163-aec4-13928977923d tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "GET /compute/v2.1/servers/e89c72f4-558a-4f0f-af56-ef337001d531" status: 200 len: 1275 microversion: 2.1 time: 0.086280 Oct 28 09:59:01.818442 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 548/1077] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:59:01 2021] GET /compute/v2.1/servers/e89c72f4-558a-4f0f-af56-ef337001d531 => generated 1275 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:02.834779 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-f1ac93e8-6d8b-48af-bf66-b214db828472 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:02.835487 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-f1ac93e8-6d8b-48af-bf66-b214db828472 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: e89c72f4-558a-4f0f-af56-ef337001d531] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:59:02.841889 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f1ac93e8-6d8b-48af-bf66-b214db828472 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:02.842341 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f1ac93e8-6d8b-48af-bf66-b214db828472 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:02.843771 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f1ac93e8-6d8b-48af-bf66-b214db828472 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:02.844215 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-f1ac93e8-6d8b-48af-bf66-b214db828472 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:02.914683 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-f1ac93e8-6d8b-48af-bf66-b214db828472 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe824ed5ea44570b4127ca6873367c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8273ac2aca774a0aa4b6a43247c31c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:02.963859 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-f1ac93e8-6d8b-48af-bf66-b214db828472 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "GET /compute/v2.1/servers/e89c72f4-558a-4f0f-af56-ef337001d531" status: 200 len: 1281 microversion: 2.1 time: 0.091894 Oct 28 09:59:02.963859 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 530/1078] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:59:02 2021] GET /compute/v2.1/servers/e89c72f4-558a-4f0f-af56-ef337001d531 => generated 1281 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:03.973687 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-17374720-6f2d-44d7-b38f-4a38b0ed4137 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:03.976994 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-17374720-6f2d-44d7-b38f-4a38b0ed4137 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: e89c72f4-558a-4f0f-af56-ef337001d531] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:59:03.980570 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-17374720-6f2d-44d7-b38f-4a38b0ed4137 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:03.981076 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-17374720-6f2d-44d7-b38f-4a38b0ed4137 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:03.981798 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-17374720-6f2d-44d7-b38f-4a38b0ed4137 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:03.982226 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-17374720-6f2d-44d7-b38f-4a38b0ed4137 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:04.124732 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-17374720-6f2d-44d7-b38f-4a38b0ed4137 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe824ed5ea44570b4127ca6873367c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8273ac2aca774a0aa4b6a43247c31c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:04.137430 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-17374720-6f2d-44d7-b38f-4a38b0ed4137 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "GET /compute/v2.1/servers/e89c72f4-558a-4f0f-af56-ef337001d531" status: 200 len: 1323 microversion: 2.1 time: 0.167302 Oct 28 09:59:04.138173 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 549/1079] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:59:03 2021] GET /compute/v2.1/servers/e89c72f4-558a-4f0f-af56-ef337001d531 => generated 1323 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:04.140071 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-10b3b701-e2ba-4ece-915c-8d79a49b8657 req-b56e21f4-341e-4fa9-b301-6332625e9b30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e89c72f4-558a-4f0f-af56-ef337001d531", "tag": "879145b6-6b1f-4837-91f2-11bf5cb09d6f"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:04.142028 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:59:04.142028 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:59:04.150400 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-10b3b701-e2ba-4ece-915c-8d79a49b8657 req-b56e21f4-341e-4fa9-b301-6332625e9b30 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:04.151138 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-10b3b701-e2ba-4ece-915c-8d79a49b8657 req-b56e21f4-341e-4fa9-b301-6332625e9b30 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:04.163390 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-10b3b701-e2ba-4ece-915c-8d79a49b8657 req-b56e21f4-341e-4fa9-b301-6332625e9b30 service nova] Creating event network-changed:879145b6-6b1f-4837-91f2-11bf5cb09d6f for instance e89c72f4-558a-4f0f-af56-ef337001d531 on hv-cinder-81571 Oct 28 09:59:04.168830 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-10b3b701-e2ba-4ece-915c-8d79a49b8657 req-b56e21f4-341e-4fa9-b301-6332625e9b30 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108303 Oct 28 09:59:04.169435 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 531/1080] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:59:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:05.159122 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-9c6f4f8c-8ebe-4b82-9e95-fd37f78b38bb tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:05.159684 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-9c6f4f8c-8ebe-4b82-9e95-fd37f78b38bb tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: e89c72f4-558a-4f0f-af56-ef337001d531] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:59:05.166704 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9c6f4f8c-8ebe-4b82-9e95-fd37f78b38bb tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:05.167146 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9c6f4f8c-8ebe-4b82-9e95-fd37f78b38bb tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:05.167921 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9c6f4f8c-8ebe-4b82-9e95-fd37f78b38bb tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:05.168344 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9c6f4f8c-8ebe-4b82-9e95-fd37f78b38bb tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:05.300747 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-9c6f4f8c-8ebe-4b82-9e95-fd37f78b38bb tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe824ed5ea44570b4127ca6873367c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8273ac2aca774a0aa4b6a43247c31c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:05.310534 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-9c6f4f8c-8ebe-4b82-9e95-fd37f78b38bb tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "GET /compute/v2.1/servers/e89c72f4-558a-4f0f-af56-ef337001d531" status: 200 len: 1323 microversion: 2.1 time: 0.155843 Oct 28 09:59:05.312189 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 550/1081] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:59:05 2021] GET /compute/v2.1/servers/e89c72f4-558a-4f0f-af56-ef337001d531 => generated 1323 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:06.329865 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-15c912f5-d304-4599-b550-5651ab1906ca tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:06.330553 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-15c912f5-d304-4599-b550-5651ab1906ca tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: e89c72f4-558a-4f0f-af56-ef337001d531] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:59:06.337137 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-15c912f5-d304-4599-b550-5651ab1906ca tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:06.337572 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-15c912f5-d304-4599-b550-5651ab1906ca tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:06.338333 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-15c912f5-d304-4599-b550-5651ab1906ca tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:06.338757 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-15c912f5-d304-4599-b550-5651ab1906ca tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:06.466154 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-15c912f5-d304-4599-b550-5651ab1906ca tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe824ed5ea44570b4127ca6873367c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8273ac2aca774a0aa4b6a43247c31c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:06.473587 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-15c912f5-d304-4599-b550-5651ab1906ca tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "GET /compute/v2.1/servers/e89c72f4-558a-4f0f-af56-ef337001d531" status: 200 len: 1323 microversion: 2.1 time: 0.148846 Oct 28 09:59:06.474154 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 532/1082] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:59:06 2021] GET /compute/v2.1/servers/e89c72f4-558a-4f0f-af56-ef337001d531 => generated 1323 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:07.490218 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-e0cafdca-6f7c-47c9-8b72-fa6bc6272bab tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:07.490826 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-e0cafdca-6f7c-47c9-8b72-fa6bc6272bab tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: e89c72f4-558a-4f0f-af56-ef337001d531] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:59:07.497367 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e0cafdca-6f7c-47c9-8b72-fa6bc6272bab tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:07.497907 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e0cafdca-6f7c-47c9-8b72-fa6bc6272bab tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:07.498640 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e0cafdca-6f7c-47c9-8b72-fa6bc6272bab tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:07.499032 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e0cafdca-6f7c-47c9-8b72-fa6bc6272bab tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:07.622382 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-e0cafdca-6f7c-47c9-8b72-fa6bc6272bab tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe824ed5ea44570b4127ca6873367c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8273ac2aca774a0aa4b6a43247c31c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:07.630425 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-e0cafdca-6f7c-47c9-8b72-fa6bc6272bab tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "GET /compute/v2.1/servers/e89c72f4-558a-4f0f-af56-ef337001d531" status: 200 len: 1323 microversion: 2.1 time: 0.143843 Oct 28 09:59:07.630984 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 551/1083] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:59:07 2021] GET /compute/v2.1/servers/e89c72f4-558a-4f0f-af56-ef337001d531 => generated 1323 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:08.647437 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-9339264a-1e6a-4a04-a66e-4e316371aa57 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:08.648116 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-9339264a-1e6a-4a04-a66e-4e316371aa57 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: e89c72f4-558a-4f0f-af56-ef337001d531] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:59:08.654281 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9339264a-1e6a-4a04-a66e-4e316371aa57 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:08.654708 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9339264a-1e6a-4a04-a66e-4e316371aa57 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:08.655468 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9339264a-1e6a-4a04-a66e-4e316371aa57 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:08.655944 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9339264a-1e6a-4a04-a66e-4e316371aa57 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:08.782353 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-9339264a-1e6a-4a04-a66e-4e316371aa57 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe824ed5ea44570b4127ca6873367c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8273ac2aca774a0aa4b6a43247c31c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:08.789889 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-9339264a-1e6a-4a04-a66e-4e316371aa57 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "GET /compute/v2.1/servers/e89c72f4-558a-4f0f-af56-ef337001d531" status: 200 len: 1323 microversion: 2.1 time: 0.146226 Oct 28 09:59:08.790460 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 533/1084] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:59:08 2021] GET /compute/v2.1/servers/e89c72f4-558a-4f0f-af56-ef337001d531 => generated 1323 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:09.807799 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-b9af915c-fd8c-4063-8b81-89ac5547b133 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:09.808384 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-b9af915c-fd8c-4063-8b81-89ac5547b133 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: e89c72f4-558a-4f0f-af56-ef337001d531] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:59:09.815751 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b9af915c-fd8c-4063-8b81-89ac5547b133 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:09.816189 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b9af915c-fd8c-4063-8b81-89ac5547b133 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:09.817000 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b9af915c-fd8c-4063-8b81-89ac5547b133 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:09.817430 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b9af915c-fd8c-4063-8b81-89ac5547b133 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:09.947773 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-b9af915c-fd8c-4063-8b81-89ac5547b133 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe824ed5ea44570b4127ca6873367c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8273ac2aca774a0aa4b6a43247c31c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:09.955486 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-b9af915c-fd8c-4063-8b81-89ac5547b133 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "GET /compute/v2.1/servers/e89c72f4-558a-4f0f-af56-ef337001d531" status: 200 len: 1323 microversion: 2.1 time: 0.151413 Oct 28 09:59:09.956058 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 552/1085] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:59:09 2021] GET /compute/v2.1/servers/e89c72f4-558a-4f0f-af56-ef337001d531 => generated 1323 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:10.467689 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-7e761001-6ff9-4baf-a8c3-59b950d9528f req-537be480-9c6e-4b79-a68c-881abb182a54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e89c72f4-558a-4f0f-af56-ef337001d531", "name": "network-vif-plugged", "status": "completed", "tag": "879145b6-6b1f-4837-91f2-11bf5cb09d6f"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:10.470526 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:59:10.470526 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:59:10.478248 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-7e761001-6ff9-4baf-a8c3-59b950d9528f req-537be480-9c6e-4b79-a68c-881abb182a54 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:10.478691 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-7e761001-6ff9-4baf-a8c3-59b950d9528f req-537be480-9c6e-4b79-a68c-881abb182a54 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:10.489819 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-7e761001-6ff9-4baf-a8c3-59b950d9528f req-537be480-9c6e-4b79-a68c-881abb182a54 service nova] Creating event network-vif-plugged:879145b6-6b1f-4837-91f2-11bf5cb09d6f for instance e89c72f4-558a-4f0f-af56-ef337001d531 on hv-cinder-81571 Oct 28 09:59:10.495110 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-7e761001-6ff9-4baf-a8c3-59b950d9528f req-537be480-9c6e-4b79-a68c-881abb182a54 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031485 Oct 28 09:59:10.495734 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 534/1086] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:59:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:10.973214 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-5085b50b-11e4-41bb-83f6-6afffd821ee7 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:10.974056 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-5085b50b-11e4-41bb-83f6-6afffd821ee7 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: e89c72f4-558a-4f0f-af56-ef337001d531] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:59:10.980169 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5085b50b-11e4-41bb-83f6-6afffd821ee7 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:10.980610 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5085b50b-11e4-41bb-83f6-6afffd821ee7 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:10.981420 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5085b50b-11e4-41bb-83f6-6afffd821ee7 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:10.981845 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5085b50b-11e4-41bb-83f6-6afffd821ee7 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:11.105045 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-5085b50b-11e4-41bb-83f6-6afffd821ee7 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe824ed5ea44570b4127ca6873367c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8273ac2aca774a0aa4b6a43247c31c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:11.113357 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-5085b50b-11e4-41bb-83f6-6afffd821ee7 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "GET /compute/v2.1/servers/e89c72f4-558a-4f0f-af56-ef337001d531" status: 200 len: 1323 microversion: 2.1 time: 0.143836 Oct 28 09:59:11.113930 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 553/1087] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:59:10 2021] GET /compute/v2.1/servers/e89c72f4-558a-4f0f-af56-ef337001d531 => generated 1323 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:12.131512 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-eab289bc-ec5f-48b2-8f28-1e95e063eff5 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:12.132384 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-eab289bc-ec5f-48b2-8f28-1e95e063eff5 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: e89c72f4-558a-4f0f-af56-ef337001d531] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:59:12.141617 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-eab289bc-ec5f-48b2-8f28-1e95e063eff5 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:12.142737 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-eab289bc-ec5f-48b2-8f28-1e95e063eff5 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:12.143658 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-eab289bc-ec5f-48b2-8f28-1e95e063eff5 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:12.144628 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-eab289bc-ec5f-48b2-8f28-1e95e063eff5 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:12.278174 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-eab289bc-ec5f-48b2-8f28-1e95e063eff5 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe824ed5ea44570b4127ca6873367c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8273ac2aca774a0aa4b6a43247c31c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:12.287184 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-eab289bc-ec5f-48b2-8f28-1e95e063eff5 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "GET /compute/v2.1/servers/e89c72f4-558a-4f0f-af56-ef337001d531" status: 200 len: 1511 microversion: 2.1 time: 0.160251 Oct 28 09:59:12.287791 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 535/1088] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:59:12 2021] GET /compute/v2.1/servers/e89c72f4-558a-4f0f-af56-ef337001d531 => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:31.911894 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-3b19d9ef-fbbc-456a-abc3-e2d348f60238 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f805b19-3d37-4104-a07a-584d76097817", "device": "/dev/sdb"}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:31.914913 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-3b19d9ef-fbbc-456a-abc3-e2d348f60238 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: e89c72f4-558a-4f0f-af56-ef337001d531] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:59:31.925146 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3b19d9ef-fbbc-456a-abc3-e2d348f60238 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:31.925599 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3b19d9ef-fbbc-456a-abc3-e2d348f60238 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:31.926385 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3b19d9ef-fbbc-456a-abc3-e2d348f60238 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:31.926812 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3b19d9ef-fbbc-456a-abc3-e2d348f60238 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:32.868874 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-3b19d9ef-fbbc-456a-abc3-e2d348f60238 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "POST /compute/v2.1/servers/e89c72f4-558a-4f0f-af56-ef337001d531/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.964278 Oct 28 09:59:32.869478 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 554/1089] 10.222.0.104 () {60 vars in 1327 bytes} [Thu Oct 28 09:59:31 2021] POST /compute/v2.1/servers/e89c72f4-558a-4f0f-af56-ef337001d531/os-volume_attachments => generated 194 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:43.711559 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-8f92f5ff-68f6-4d5c-864a-75d1a05f36fe tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:43.712172 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-8f92f5ff-68f6-4d5c-864a-75d1a05f36fe tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 0d8c7f9d-ae44-4516-a430-e19cf05cda9f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:59:43.718478 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8f92f5ff-68f6-4d5c-864a-75d1a05f36fe tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:43.718991 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8f92f5ff-68f6-4d5c-864a-75d1a05f36fe tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:43.719790 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8f92f5ff-68f6-4d5c-864a-75d1a05f36fe tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:43.720221 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8f92f5ff-68f6-4d5c-864a-75d1a05f36fe tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:43.745912 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-8f92f5ff-68f6-4d5c-864a-75d1a05f36fe tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 0d8c7f9d-ae44-4516-a430-e19cf05cda9f] Going to try to terminate instance {{(pid=123068) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 09:59:44.086553 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-8f92f5ff-68f6-4d5c-864a-75d1a05f36fe tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "DELETE /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f" status: 204 len: 0 microversion: 2.1 time: 0.378352 Oct 28 09:59:44.087143 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 536/1090] 10.222.0.104 () {58 vars in 1243 bytes} [Thu Oct 28 09:59:43 2021] DELETE /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:59:44.096893 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-adde00f7-e9c1-4a58-a371-af711be058a1 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:44.097653 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-adde00f7-e9c1-4a58-a371-af711be058a1 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 0d8c7f9d-ae44-4516-a430-e19cf05cda9f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:59:44.105496 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-adde00f7-e9c1-4a58-a371-af711be058a1 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:44.105496 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-adde00f7-e9c1-4a58-a371-af711be058a1 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:44.105496 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-adde00f7-e9c1-4a58-a371-af711be058a1 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:44.105867 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-adde00f7-e9c1-4a58-a371-af711be058a1 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:44.262371 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-adde00f7-e9c1-4a58-a371-af711be058a1 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:44.271031 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-adde00f7-e9c1-4a58-a371-af711be058a1 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f" status: 200 len: 1578 microversion: 2.1 time: 0.179021 Oct 28 09:59:44.271667 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 555/1091] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:59:44 2021] GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f => generated 1578 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:45.294235 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-cf7a7bbc-e712-4bae-b753-b1b8c6d9d634 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:45.295471 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-cf7a7bbc-e712-4bae-b753-b1b8c6d9d634 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 0d8c7f9d-ae44-4516-a430-e19cf05cda9f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:59:45.303204 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cf7a7bbc-e712-4bae-b753-b1b8c6d9d634 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:45.303651 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cf7a7bbc-e712-4bae-b753-b1b8c6d9d634 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:45.304469 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cf7a7bbc-e712-4bae-b753-b1b8c6d9d634 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:45.305126 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-cf7a7bbc-e712-4bae-b753-b1b8c6d9d634 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:45.441180 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-cf7a7bbc-e712-4bae-b753-b1b8c6d9d634 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:45.449725 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-cf7a7bbc-e712-4bae-b753-b1b8c6d9d634 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f" status: 200 len: 1578 microversion: 2.1 time: 0.162935 Oct 28 09:59:45.450329 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 537/1092] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:59:45 2021] GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:46.466912 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-fa32e55c-7584-4214-bcf5-d402d1d8d096 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:46.468370 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-fa32e55c-7584-4214-bcf5-d402d1d8d096 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 0d8c7f9d-ae44-4516-a430-e19cf05cda9f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:59:46.474984 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fa32e55c-7584-4214-bcf5-d402d1d8d096 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:46.475433 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fa32e55c-7584-4214-bcf5-d402d1d8d096 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:46.476191 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fa32e55c-7584-4214-bcf5-d402d1d8d096 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:46.476640 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fa32e55c-7584-4214-bcf5-d402d1d8d096 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:46.603557 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-fa32e55c-7584-4214-bcf5-d402d1d8d096 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:46.611511 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-fa32e55c-7584-4214-bcf5-d402d1d8d096 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f" status: 200 len: 1578 microversion: 2.1 time: 0.148237 Oct 28 09:59:46.612106 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 556/1093] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:59:46 2021] GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f => generated 1578 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:47.629582 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-8a46bdcc-0b42-4f1d-9f6e-cea6889b2669 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:47.630182 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-8a46bdcc-0b42-4f1d-9f6e-cea6889b2669 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 0d8c7f9d-ae44-4516-a430-e19cf05cda9f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:59:47.636588 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8a46bdcc-0b42-4f1d-9f6e-cea6889b2669 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:47.637085 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8a46bdcc-0b42-4f1d-9f6e-cea6889b2669 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:47.637859 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8a46bdcc-0b42-4f1d-9f6e-cea6889b2669 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:47.638292 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8a46bdcc-0b42-4f1d-9f6e-cea6889b2669 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:47.772238 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-8a46bdcc-0b42-4f1d-9f6e-cea6889b2669 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:47.780611 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-8a46bdcc-0b42-4f1d-9f6e-cea6889b2669 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f" status: 200 len: 1578 microversion: 2.1 time: 0.154165 Oct 28 09:59:47.781333 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 538/1094] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:59:47 2021] GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:48.800580 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-39e0f9c7-151b-467d-b33d-402cf57c3673 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:48.801866 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-39e0f9c7-151b-467d-b33d-402cf57c3673 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 0d8c7f9d-ae44-4516-a430-e19cf05cda9f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:59:48.808866 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-39e0f9c7-151b-467d-b33d-402cf57c3673 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:48.810567 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-39e0f9c7-151b-467d-b33d-402cf57c3673 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:48.810567 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-39e0f9c7-151b-467d-b33d-402cf57c3673 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:48.811191 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-39e0f9c7-151b-467d-b33d-402cf57c3673 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:48.952732 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-39e0f9c7-151b-467d-b33d-402cf57c3673 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:48.962792 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-39e0f9c7-151b-467d-b33d-402cf57c3673 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f" status: 200 len: 1578 microversion: 2.1 time: 0.168088 Oct 28 09:59:48.963467 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 557/1095] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:59:48 2021] GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f => generated 1578 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:49.630615 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-5347e2b4-fd15-40cc-8f12-c8ce58619001 req-be14b4ef-121e-4335-8120-998d4789928b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d8c7f9d-ae44-4516-a430-e19cf05cda9f", "name": "network-vif-deleted", "tag": "ab88f822-dd8c-4d3c-aaeb-f786c078a662"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:49.632142 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 09:59:49.632142 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 09:59:49.660373 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-5347e2b4-fd15-40cc-8f12-c8ce58619001 req-be14b4ef-121e-4335-8120-998d4789928b service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:49.661139 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-5347e2b4-fd15-40cc-8f12-c8ce58619001 req-be14b4ef-121e-4335-8120-998d4789928b service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:49.679852 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-5347e2b4-fd15-40cc-8f12-c8ce58619001 req-be14b4ef-121e-4335-8120-998d4789928b service nova] Creating event network-vif-deleted:ab88f822-dd8c-4d3c-aaeb-f786c078a662 for instance 0d8c7f9d-ae44-4516-a430-e19cf05cda9f on hv-cinder-81571 Oct 28 09:59:49.687566 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-5347e2b4-fd15-40cc-8f12-c8ce58619001 req-be14b4ef-121e-4335-8120-998d4789928b service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058773 Oct 28 09:59:49.688542 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 539/1096] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 09:59:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:49.980149 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-46aa02f0-7032-4feb-ab65-7f071aaf3d84 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:49.980791 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-46aa02f0-7032-4feb-ab65-7f071aaf3d84 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 0d8c7f9d-ae44-4516-a430-e19cf05cda9f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:59:49.988019 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-46aa02f0-7032-4feb-ab65-7f071aaf3d84 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:49.988455 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-46aa02f0-7032-4feb-ab65-7f071aaf3d84 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:49.989267 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-46aa02f0-7032-4feb-ab65-7f071aaf3d84 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:49.989682 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-46aa02f0-7032-4feb-ab65-7f071aaf3d84 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:50.053271 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-46aa02f0-7032-4feb-ab65-7f071aaf3d84 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:50.060451 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-46aa02f0-7032-4feb-ab65-7f071aaf3d84 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f" status: 200 len: 1225 microversion: 2.1 time: 0.084411 Oct 28 09:59:50.061155 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 558/1097] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:59:49 2021] GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:51.079782 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-e8b647ee-b204-491d-8866-d2c300a6c956 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:51.080394 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-e8b647ee-b204-491d-8866-d2c300a6c956 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 0d8c7f9d-ae44-4516-a430-e19cf05cda9f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:59:51.086509 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e8b647ee-b204-491d-8866-d2c300a6c956 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:51.086958 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e8b647ee-b204-491d-8866-d2c300a6c956 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:51.087732 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e8b647ee-b204-491d-8866-d2c300a6c956 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:51.088161 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e8b647ee-b204-491d-8866-d2c300a6c956 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:51.118704 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e8b647ee-b204-491d-8866-d2c300a6c956 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:51.119148 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e8b647ee-b204-491d-8866-d2c300a6c956 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:51.119600 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.objects.instance [None req-e8b647ee-b204-491d-8866-d2c300a6c956 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lazy-loading 'fault' on Instance uuid 0d8c7f9d-ae44-4516-a430-e19cf05cda9f {{(pid=123068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 09:59:51.160389 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-e8b647ee-b204-491d-8866-d2c300a6c956 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:51.167798 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-e8b647ee-b204-491d-8866-d2c300a6c956 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f" status: 200 len: 1230 microversion: 2.1 time: 0.093285 Oct 28 09:59:51.168373 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 540/1098] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:59:51 2021] GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f => generated 1230 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:52.184736 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-cc0aac45-bde9-4e6c-ab60-3e50c23bccda tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:52.185348 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-cc0aac45-bde9-4e6c-ab60-3e50c23bccda tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 0d8c7f9d-ae44-4516-a430-e19cf05cda9f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:59:52.192000 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-cc0aac45-bde9-4e6c-ab60-3e50c23bccda tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:52.192511 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-cc0aac45-bde9-4e6c-ab60-3e50c23bccda tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:52.193310 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-cc0aac45-bde9-4e6c-ab60-3e50c23bccda tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:52.193744 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-cc0aac45-bde9-4e6c-ab60-3e50c23bccda tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:52.224722 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-cc0aac45-bde9-4e6c-ab60-3e50c23bccda tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:52.225169 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-cc0aac45-bde9-4e6c-ab60-3e50c23bccda tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:52.225614 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.objects.instance [None req-cc0aac45-bde9-4e6c-ab60-3e50c23bccda tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lazy-loading 'fault' on Instance uuid 0d8c7f9d-ae44-4516-a430-e19cf05cda9f {{(pid=123069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 09:59:52.265590 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-cc0aac45-bde9-4e6c-ab60-3e50c23bccda tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:52.273392 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-cc0aac45-bde9-4e6c-ab60-3e50c23bccda tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f" status: 200 len: 1230 microversion: 2.1 time: 0.092504 Oct 28 09:59:52.274030 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 559/1099] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:59:52 2021] GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f => generated 1230 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:53.290709 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-2826f89d-b5ae-46bf-b6b0-bc8fb718bb79 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:53.291337 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-2826f89d-b5ae-46bf-b6b0-bc8fb718bb79 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 0d8c7f9d-ae44-4516-a430-e19cf05cda9f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:59:53.298733 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2826f89d-b5ae-46bf-b6b0-bc8fb718bb79 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:53.299222 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2826f89d-b5ae-46bf-b6b0-bc8fb718bb79 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:53.300070 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2826f89d-b5ae-46bf-b6b0-bc8fb718bb79 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:53.300519 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2826f89d-b5ae-46bf-b6b0-bc8fb718bb79 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:53.333402 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2826f89d-b5ae-46bf-b6b0-bc8fb718bb79 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:53.333991 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-2826f89d-b5ae-46bf-b6b0-bc8fb718bb79 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:53.334478 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.objects.instance [None req-2826f89d-b5ae-46bf-b6b0-bc8fb718bb79 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lazy-loading 'fault' on Instance uuid 0d8c7f9d-ae44-4516-a430-e19cf05cda9f {{(pid=123068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 09:59:53.377929 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-2826f89d-b5ae-46bf-b6b0-bc8fb718bb79 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:53.385359 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-2826f89d-b5ae-46bf-b6b0-bc8fb718bb79 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f" status: 200 len: 1230 microversion: 2.1 time: 0.098573 Oct 28 09:59:53.385921 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 541/1100] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:59:53 2021] GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f => generated 1230 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:54.402731 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-8822b95e-4e51-4750-8f2c-4c6ec9c39639 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:54.403270 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-8822b95e-4e51-4750-8f2c-4c6ec9c39639 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 0d8c7f9d-ae44-4516-a430-e19cf05cda9f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:59:54.410459 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8822b95e-4e51-4750-8f2c-4c6ec9c39639 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:54.410905 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8822b95e-4e51-4750-8f2c-4c6ec9c39639 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:54.411683 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8822b95e-4e51-4750-8f2c-4c6ec9c39639 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:54.412113 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-8822b95e-4e51-4750-8f2c-4c6ec9c39639 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:54.428121 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.wsgi [None req-8822b95e-4e51-4750-8f2c-4c6ec9c39639 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] HTTP exception thrown: Instance 0d8c7f9d-ae44-4516-a430-e19cf05cda9f could not be found. Oct 28 09:59:54.428762 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-8822b95e-4e51-4750-8f2c-4c6ec9c39639 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Returning 404 to user: Instance 0d8c7f9d-ae44-4516-a430-e19cf05cda9f could not be found. {{(pid=123069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 09:59:54.429595 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-8822b95e-4e51-4750-8f2c-4c6ec9c39639 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f" status: 404 len: 111 microversion: 2.1 time: 0.030707 Oct 28 09:59:54.430155 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 560/1101] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:59:54 2021] GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:59:54.527142 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-a04afb3b-7193-4718-a5a5-7e04d24e7e5a tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1525458453", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-87968533", "security_groups": [{"name": "tempest-secgroup-smoke-1252555229"}], "block_device_mapping_v2": [{"uuid": "d2182ad6-0e5b-450c-a786-c9f6b22c88c7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5478037d-e561-4e8b-811e-6f93ca4dff8e"}]}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:54.628262 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.network.neutron [None req-a04afb3b-7193-4718-a5a5-7e04d24e7e5a tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] validate_networks() for [('5478037d-e561-4e8b-811e-6f93ca4dff8e', None, None, None, None, None)] {{(pid=123068) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 09:59:55.006616 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-a04afb3b-7193-4718-a5a5-7e04d24e7e5a tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Flavor limits 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:59:55.007043 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-a04afb3b-7193-4718-a5a5-7e04d24e7e5a tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Image limits 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:59:55.007517 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-a04afb3b-7193-4718-a5a5-7e04d24e7e5a tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Flavor pref 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:59:55.007927 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-a04afb3b-7193-4718-a5a5-7e04d24e7e5a tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Image pref 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:59:55.008340 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-a04afb3b-7193-4718-a5a5-7e04d24e7e5a tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:59:55.017862 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a04afb3b-7193-4718-a5a5-7e04d24e7e5a tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:55.018302 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a04afb3b-7193-4718-a5a5-7e04d24e7e5a tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:55.019105 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a04afb3b-7193-4718-a5a5-7e04d24e7e5a tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:55.019529 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a04afb3b-7193-4718-a5a5-7e04d24e7e5a tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:55.036361 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.quota [None req-a04afb3b-7193-4718-a5a5-7e04d24e7e5a tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Getting quotas for project 8891d4ce726f4b84a18cbb3bce4e53c3. Resources: {'ram', 'cores', 'instances'} {{(pid=123068) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 09:59:55.041247 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.quota [None req-a04afb3b-7193-4718-a5a5-7e04d24e7e5a tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Getting quotas for user c6c7a9975b554c30956dcd3d34b93a97 and project 8891d4ce726f4b84a18cbb3bce4e53c3. Resources: {'ram', 'cores', 'instances'} {{(pid=123068) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 09:59:55.096639 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-a04afb3b-7193-4718-a5a5-7e04d24e7e5a tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Going to run 1 instances... {{(pid=123068) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 09:59:55.098867 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-a04afb3b-7193-4718-a5a5-7e04d24e7e5a tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 535c0fe1-83a7-48c6-b8d5-edb548a9d8a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d2182ad6-0e5b-450c-a786-c9f6b22c88c7',volume_size=None,volume_type=None)] {{(pid=123068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 09:59:55.510862 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-a04afb3b-7193-4718-a5a5-7e04d24e7e5a tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.987357 Oct 28 09:59:55.511514 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 542/1102] 10.222.0.104 () {60 vars in 1151 bytes} [Thu Oct 28 09:59:54 2021] POST /compute/v2.1/servers => generated 408 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 28 09:59:55.522067 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-ee81bb08-f3c7-4701-8c5a-1a1247d353a3 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:55.522664 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-ee81bb08-f3c7-4701-8c5a-1a1247d353a3 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 535c0fe1-83a7-48c6-b8d5-edb548a9d8a1] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:59:55.575750 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-ee81bb08-f3c7-4701-8c5a-1a1247d353a3 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:55.583125 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-ee81bb08-f3c7-4701-8c5a-1a1247d353a3 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1" status: 200 len: 1096 microversion: 2.1 time: 0.065003 Oct 28 09:59:55.583680 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 561/1103] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:59:55 2021] GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1 => generated 1096 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:56.600096 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-8210182a-bead-45e2-ad77-fe0b84c21e9a tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:56.600735 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-8210182a-bead-45e2-ad77-fe0b84c21e9a tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 535c0fe1-83a7-48c6-b8d5-edb548a9d8a1] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:59:56.659476 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-8210182a-bead-45e2-ad77-fe0b84c21e9a tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:56.665978 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-8210182a-bead-45e2-ad77-fe0b84c21e9a tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1" status: 200 len: 1096 microversion: 2.1 time: 0.070101 Oct 28 09:59:56.666538 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 543/1104] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:59:56 2021] GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1 => generated 1096 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:57.568742 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-f920865f-8180-431c-9fbf-6988d90d21c3 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:57.569244 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-f920865f-8180-431c-9fbf-6988d90d21c3 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: e89c72f4-558a-4f0f-af56-ef337001d531] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:59:57.576415 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f920865f-8180-431c-9fbf-6988d90d21c3 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:57.576973 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f920865f-8180-431c-9fbf-6988d90d21c3 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:57.578199 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f920865f-8180-431c-9fbf-6988d90d21c3 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:57.578978 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f920865f-8180-431c-9fbf-6988d90d21c3 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:57.664406 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.objects.instance [None req-f920865f-8180-431c-9fbf-6988d90d21c3 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lazy-loading 'services' on Instance uuid e89c72f4-558a-4f0f-af56-ef337001d531 {{(pid=123069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 09:59:57.683739 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-fec469d9-56d9-45d9-873e-717c8bb5c1c0 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:57.684460 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-fec469d9-56d9-45d9-873e-717c8bb5c1c0 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 535c0fe1-83a7-48c6-b8d5-edb548a9d8a1] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:59:57.741078 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-fec469d9-56d9-45d9-873e-717c8bb5c1c0 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:57.747968 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-fec469d9-56d9-45d9-873e-717c8bb5c1c0 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1" status: 200 len: 1096 microversion: 2.1 time: 0.068080 Oct 28 09:59:57.748543 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 544/1105] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:59:57 2021] GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1 => generated 1096 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:57.938548 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-f920865f-8180-431c-9fbf-6988d90d21c3 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "DELETE /compute/v2.1/servers/e89c72f4-558a-4f0f-af56-ef337001d531/os-volume_attachments/3f805b19-3d37-4104-a07a-584d76097817" status: 202 len: 0 microversion: 2.1 time: 0.372657 Oct 28 09:59:57.940108 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 562/1106] 10.222.0.104 () {58 vars in 1420 bytes} [Thu Oct 28 09:59:57 2021] DELETE /compute/v2.1/servers/e89c72f4-558a-4f0f-af56-ef337001d531/os-volume_attachments/3f805b19-3d37-4104-a07a-584d76097817 => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:59:58.766092 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-3bce4b75-92ac-4a25-b4a7-1041e6dade14 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:58.766718 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-3bce4b75-92ac-4a25-b4a7-1041e6dade14 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 535c0fe1-83a7-48c6-b8d5-edb548a9d8a1] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:59:58.825720 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-3bce4b75-92ac-4a25-b4a7-1041e6dade14 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:58.833667 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-3bce4b75-92ac-4a25-b4a7-1041e6dade14 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1" status: 200 len: 1096 microversion: 2.1 time: 0.071079 Oct 28 09:59:58.834484 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 545/1107] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:59:58 2021] GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1 => generated 1096 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:59.051042 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-43aa2835-e2e2-4ef7-9c08-ca682f9bea49 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:59.051587 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-43aa2835-e2e2-4ef7-9c08-ca682f9bea49 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: e89c72f4-558a-4f0f-af56-ef337001d531] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:59:59.057719 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-43aa2835-e2e2-4ef7-9c08-ca682f9bea49 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:59.058153 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-43aa2835-e2e2-4ef7-9c08-ca682f9bea49 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:59.058925 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-43aa2835-e2e2-4ef7-9c08-ca682f9bea49 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:59.059346 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-43aa2835-e2e2-4ef7-9c08-ca682f9bea49 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:59.085740 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-43aa2835-e2e2-4ef7-9c08-ca682f9bea49 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: e89c72f4-558a-4f0f-af56-ef337001d531] Going to try to terminate instance {{(pid=123069) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 09:59:59.410898 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-43aa2835-e2e2-4ef7-9c08-ca682f9bea49 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "DELETE /compute/v2.1/servers/e89c72f4-558a-4f0f-af56-ef337001d531" status: 204 len: 0 microversion: 2.1 time: 0.364764 Oct 28 09:59:59.411403 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 563/1108] 10.222.0.104 () {58 vars in 1243 bytes} [Thu Oct 28 09:59:59 2021] DELETE /compute/v2.1/servers/e89c72f4-558a-4f0f-af56-ef337001d531 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:59:59.419469 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-581e7082-9527-4713-9cfc-f5bc2684178a tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:59.420065 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-581e7082-9527-4713-9cfc-f5bc2684178a tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: e89c72f4-558a-4f0f-af56-ef337001d531] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:59:59.427342 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-581e7082-9527-4713-9cfc-f5bc2684178a tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:59.427793 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-581e7082-9527-4713-9cfc-f5bc2684178a tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:59.428634 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-581e7082-9527-4713-9cfc-f5bc2684178a tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:59.429100 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-581e7082-9527-4713-9cfc-f5bc2684178a tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:59.556447 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-581e7082-9527-4713-9cfc-f5bc2684178a tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe824ed5ea44570b4127ca6873367c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8273ac2aca774a0aa4b6a43247c31c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:59.564084 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-581e7082-9527-4713-9cfc-f5bc2684178a tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "GET /compute/v2.1/servers/e89c72f4-558a-4f0f-af56-ef337001d531" status: 200 len: 1517 microversion: 2.1 time: 0.148127 Oct 28 09:59:59.564780 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 546/1109] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:59:59 2021] GET /compute/v2.1/servers/e89c72f4-558a-4f0f-af56-ef337001d531 => generated 1517 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:59.851788 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-7a1e8802-ae41-4c07-a042-f4c2053ac8f7 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:59.852489 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-7a1e8802-ae41-4c07-a042-f4c2053ac8f7 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 535c0fe1-83a7-48c6-b8d5-edb548a9d8a1] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 09:59:59.858473 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7a1e8802-ae41-4c07-a042-f4c2053ac8f7 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:59.858921 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7a1e8802-ae41-4c07-a042-f4c2053ac8f7 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:59.859717 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7a1e8802-ae41-4c07-a042-f4c2053ac8f7 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 09:59:59.860150 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7a1e8802-ae41-4c07-a042-f4c2053ac8f7 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 09:59:59.924342 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-7a1e8802-ae41-4c07-a042-f4c2053ac8f7 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:59.931922 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-7a1e8802-ae41-4c07-a042-f4c2053ac8f7 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1" status: 200 len: 1146 microversion: 2.1 time: 0.084268 Oct 28 09:59:59.932529 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 564/1110] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 09:59:59 2021] GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1 => generated 1146 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:00.581839 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-654b2e8c-1937-42e4-8df2-d36bea39e4da tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:00.592682 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-654b2e8c-1937-42e4-8df2-d36bea39e4da tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: e89c72f4-558a-4f0f-af56-ef337001d531] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:00.592682 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-654b2e8c-1937-42e4-8df2-d36bea39e4da tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:00.592682 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-654b2e8c-1937-42e4-8df2-d36bea39e4da tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:00.592682 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-654b2e8c-1937-42e4-8df2-d36bea39e4da tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:00.593107 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-654b2e8c-1937-42e4-8df2-d36bea39e4da tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:00.713857 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-654b2e8c-1937-42e4-8df2-d36bea39e4da tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe824ed5ea44570b4127ca6873367c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8273ac2aca774a0aa4b6a43247c31c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:00.721643 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-654b2e8c-1937-42e4-8df2-d36bea39e4da tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "GET /compute/v2.1/servers/e89c72f4-558a-4f0f-af56-ef337001d531" status: 200 len: 1517 microversion: 2.1 time: 0.143745 Oct 28 10:00:00.722109 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 547/1111] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:00:00 2021] GET /compute/v2.1/servers/e89c72f4-558a-4f0f-af56-ef337001d531 => generated 1517 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:00.948542 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-1df6a6c2-3aad-4067-acb0-93352f1bbbe3 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:00.949181 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-1df6a6c2-3aad-4067-acb0-93352f1bbbe3 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 535c0fe1-83a7-48c6-b8d5-edb548a9d8a1] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:00.955488 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1df6a6c2-3aad-4067-acb0-93352f1bbbe3 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:00.955922 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1df6a6c2-3aad-4067-acb0-93352f1bbbe3 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:00.956952 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1df6a6c2-3aad-4067-acb0-93352f1bbbe3 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:00.957139 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-1df6a6c2-3aad-4067-acb0-93352f1bbbe3 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:01.023474 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-1df6a6c2-3aad-4067-acb0-93352f1bbbe3 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:01.030973 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-1df6a6c2-3aad-4067-acb0-93352f1bbbe3 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1" status: 200 len: 1138 microversion: 2.1 time: 0.085955 Oct 28 10:00:01.032044 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 565/1112] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:00:00 2021] GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1 => generated 1138 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:01.586642 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-d2577439-218c-4c8b-9352-bfa3a9900c83 req-e266e328-d8ab-4c80-86c4-ed3ee691cede service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e89c72f4-558a-4f0f-af56-ef337001d531", "name": "network-vif-deleted", "tag": "879145b6-6b1f-4837-91f2-11bf5cb09d6f"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:00:01.588398 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:00:01.588398 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 10:00:01.597766 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-d2577439-218c-4c8b-9352-bfa3a9900c83 req-e266e328-d8ab-4c80-86c4-ed3ee691cede service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:01.598292 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-d2577439-218c-4c8b-9352-bfa3a9900c83 req-e266e328-d8ab-4c80-86c4-ed3ee691cede service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:01.610084 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-d2577439-218c-4c8b-9352-bfa3a9900c83 req-e266e328-d8ab-4c80-86c4-ed3ee691cede service nova] Creating event network-vif-deleted:879145b6-6b1f-4837-91f2-11bf5cb09d6f for instance e89c72f4-558a-4f0f-af56-ef337001d531 on hv-cinder-81571 Oct 28 10:00:01.616774 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-d2577439-218c-4c8b-9352-bfa3a9900c83 req-e266e328-d8ab-4c80-86c4-ed3ee691cede service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033379 Oct 28 10:00:01.617384 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 548/1113] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 10:00:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:00:01.740129 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-68ed968d-c46a-4295-94c6-dea367dd76bb tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:01.740984 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-68ed968d-c46a-4295-94c6-dea367dd76bb tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: e89c72f4-558a-4f0f-af56-ef337001d531] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:01.747377 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-68ed968d-c46a-4295-94c6-dea367dd76bb tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:01.748217 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-68ed968d-c46a-4295-94c6-dea367dd76bb tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:01.749103 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-68ed968d-c46a-4295-94c6-dea367dd76bb tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:01.749629 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-68ed968d-c46a-4295-94c6-dea367dd76bb tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:01.848598 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-68ed968d-c46a-4295-94c6-dea367dd76bb tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe824ed5ea44570b4127ca6873367c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8273ac2aca774a0aa4b6a43247c31c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:01.856349 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-68ed968d-c46a-4295-94c6-dea367dd76bb tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "GET /compute/v2.1/servers/e89c72f4-558a-4f0f-af56-ef337001d531" status: 200 len: 1308 microversion: 2.1 time: 0.121422 Oct 28 10:00:01.856955 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 566/1114] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:00:01 2021] GET /compute/v2.1/servers/e89c72f4-558a-4f0f-af56-ef337001d531 => generated 1308 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:02.049949 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-c13ef3f9-45fb-4828-942a-b8b55c2333bd tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:02.050778 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-c13ef3f9-45fb-4828-942a-b8b55c2333bd tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 535c0fe1-83a7-48c6-b8d5-edb548a9d8a1] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:02.056893 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c13ef3f9-45fb-4828-942a-b8b55c2333bd tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:02.057336 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c13ef3f9-45fb-4828-942a-b8b55c2333bd tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:02.058116 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c13ef3f9-45fb-4828-942a-b8b55c2333bd tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:02.058546 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c13ef3f9-45fb-4828-942a-b8b55c2333bd tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:02.127410 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-c13ef3f9-45fb-4828-942a-b8b55c2333bd tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:02.135234 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-c13ef3f9-45fb-4828-942a-b8b55c2333bd tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1" status: 200 len: 1212 microversion: 2.1 time: 0.089733 Oct 28 10:00:02.135826 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 549/1115] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:00:02 2021] GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1 => generated 1212 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:02.873376 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-2e904828-7781-45ca-9211-ddec0f40b32e tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:02.874077 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-2e904828-7781-45ca-9211-ddec0f40b32e tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: e89c72f4-558a-4f0f-af56-ef337001d531] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:02.881538 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2e904828-7781-45ca-9211-ddec0f40b32e tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:02.881983 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2e904828-7781-45ca-9211-ddec0f40b32e tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:02.882768 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2e904828-7781-45ca-9211-ddec0f40b32e tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:02.883194 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-2e904828-7781-45ca-9211-ddec0f40b32e tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:02.898803 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.wsgi [None req-2e904828-7781-45ca-9211-ddec0f40b32e tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] HTTP exception thrown: Instance e89c72f4-558a-4f0f-af56-ef337001d531 could not be found. Oct 28 10:00:02.899395 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-2e904828-7781-45ca-9211-ddec0f40b32e tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Returning 404 to user: Instance e89c72f4-558a-4f0f-af56-ef337001d531 could not be found. {{(pid=123069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 10:00:02.900225 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-2e904828-7781-45ca-9211-ddec0f40b32e tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "GET /compute/v2.1/servers/e89c72f4-558a-4f0f-af56-ef337001d531" status: 404 len: 111 microversion: 2.1 time: 0.030589 Oct 28 10:00:02.904106 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 567/1116] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:00:02 2021] GET /compute/v2.1/servers/e89c72f4-558a-4f0f-af56-ef337001d531 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:00:03.156457 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-5d605507-af20-420f-85a7-7bb167f9609a tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:03.159451 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-5d605507-af20-420f-85a7-7bb167f9609a tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 535c0fe1-83a7-48c6-b8d5-edb548a9d8a1] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:03.164613 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5d605507-af20-420f-85a7-7bb167f9609a tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:03.165087 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5d605507-af20-420f-85a7-7bb167f9609a tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:03.165871 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5d605507-af20-420f-85a7-7bb167f9609a tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:03.166325 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-5d605507-af20-420f-85a7-7bb167f9609a tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:03.367883 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-5d605507-af20-420f-85a7-7bb167f9609a tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:03.379467 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-5d605507-af20-420f-85a7-7bb167f9609a tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1" status: 200 len: 1268 microversion: 2.1 time: 0.223662 Oct 28 10:00:03.379467 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 550/1117] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:00:03 2021] GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1 => generated 1268 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:03.829006 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [req-aefb9d0e-879c-4546-90bb-3476ea3a8eee req-00f40eb0-b17d-4f28-be11-412775085275 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "535c0fe1-83a7-48c6-b8d5-edb548a9d8a1", "tag": "5f5d6985-145d-4f21-8120-003269e5b4c1"}]} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:00:03.831921 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:00:03.831921 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 10:00:03.839530 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-aefb9d0e-879c-4546-90bb-3476ea3a8eee req-00f40eb0-b17d-4f28-be11-412775085275 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:03.840094 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-aefb9d0e-879c-4546-90bb-3476ea3a8eee req-00f40eb0-b17d-4f28-be11-412775085275 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:03.857540 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.compute.server_external_events [req-aefb9d0e-879c-4546-90bb-3476ea3a8eee req-00f40eb0-b17d-4f28-be11-412775085275 service nova] Creating event network-changed:5f5d6985-145d-4f21-8120-003269e5b4c1 for instance 535c0fe1-83a7-48c6-b8d5-edb548a9d8a1 on hv-cinder-81571 Oct 28 10:00:03.863306 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [req-aefb9d0e-879c-4546-90bb-3476ea3a8eee req-00f40eb0-b17d-4f28-be11-412775085275 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038089 Oct 28 10:00:03.863896 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 568/1118] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 10:00:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:00:04.394657 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-eb8319bc-f322-4df5-ac3d-cc759de7b8f8 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:04.395271 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-eb8319bc-f322-4df5-ac3d-cc759de7b8f8 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 535c0fe1-83a7-48c6-b8d5-edb548a9d8a1] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:04.401376 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-eb8319bc-f322-4df5-ac3d-cc759de7b8f8 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:04.401871 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-eb8319bc-f322-4df5-ac3d-cc759de7b8f8 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:04.402585 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-eb8319bc-f322-4df5-ac3d-cc759de7b8f8 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:04.403017 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-eb8319bc-f322-4df5-ac3d-cc759de7b8f8 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:04.527396 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-eb8319bc-f322-4df5-ac3d-cc759de7b8f8 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:04.534713 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-eb8319bc-f322-4df5-ac3d-cc759de7b8f8 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1" status: 200 len: 1268 microversion: 2.1 time: 0.144789 Oct 28 10:00:04.535278 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 551/1119] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:00:04 2021] GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1 => generated 1268 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:05.553087 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-c4e221f7-733b-4577-8d42-38c8cd982123 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:05.553789 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-c4e221f7-733b-4577-8d42-38c8cd982123 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 535c0fe1-83a7-48c6-b8d5-edb548a9d8a1] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:05.559871 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c4e221f7-733b-4577-8d42-38c8cd982123 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:05.560316 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c4e221f7-733b-4577-8d42-38c8cd982123 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:05.561104 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c4e221f7-733b-4577-8d42-38c8cd982123 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:05.561534 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c4e221f7-733b-4577-8d42-38c8cd982123 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:05.693020 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-c4e221f7-733b-4577-8d42-38c8cd982123 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:05.700556 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-c4e221f7-733b-4577-8d42-38c8cd982123 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1" status: 200 len: 1268 microversion: 2.1 time: 0.152532 Oct 28 10:00:05.701166 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 569/1120] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:00:05 2021] GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1 => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:00:06.718265 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-e139c713-25a9-4e11-bb96-c7989778457b tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:06.719049 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-e139c713-25a9-4e11-bb96-c7989778457b tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 535c0fe1-83a7-48c6-b8d5-edb548a9d8a1] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:06.725942 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e139c713-25a9-4e11-bb96-c7989778457b tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:06.726397 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e139c713-25a9-4e11-bb96-c7989778457b tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:06.727177 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e139c713-25a9-4e11-bb96-c7989778457b tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:06.727612 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e139c713-25a9-4e11-bb96-c7989778457b tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:06.933398 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-e139c713-25a9-4e11-bb96-c7989778457b tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:06.941714 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-e139c713-25a9-4e11-bb96-c7989778457b tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1" status: 200 len: 1268 microversion: 2.1 time: 0.227049 Oct 28 10:00:06.942332 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 552/1121] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:00:06 2021] GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1 => generated 1268 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:07.958437 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-3d7c53ac-20bd-4db4-91d8-5f0310184ea0 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:07.959018 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-3d7c53ac-20bd-4db4-91d8-5f0310184ea0 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 535c0fe1-83a7-48c6-b8d5-edb548a9d8a1] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:07.965300 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3d7c53ac-20bd-4db4-91d8-5f0310184ea0 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:07.965733 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3d7c53ac-20bd-4db4-91d8-5f0310184ea0 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:07.966496 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3d7c53ac-20bd-4db4-91d8-5f0310184ea0 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:07.966920 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-3d7c53ac-20bd-4db4-91d8-5f0310184ea0 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:08.093100 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-3d7c53ac-20bd-4db4-91d8-5f0310184ea0 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:08.101300 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-3d7c53ac-20bd-4db4-91d8-5f0310184ea0 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1" status: 200 len: 1268 microversion: 2.1 time: 0.146625 Oct 28 10:00:08.102394 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 570/1122] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:00:07 2021] GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1 => generated 1268 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:09.120584 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-76c595c1-516b-4dee-a8c8-1b98f54d5206 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:09.121458 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-76c595c1-516b-4dee-a8c8-1b98f54d5206 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 535c0fe1-83a7-48c6-b8d5-edb548a9d8a1] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:09.128396 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-76c595c1-516b-4dee-a8c8-1b98f54d5206 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:09.133598 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-76c595c1-516b-4dee-a8c8-1b98f54d5206 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:09.133598 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-76c595c1-516b-4dee-a8c8-1b98f54d5206 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:09.133598 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-76c595c1-516b-4dee-a8c8-1b98f54d5206 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:09.260526 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-76c595c1-516b-4dee-a8c8-1b98f54d5206 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:09.268930 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-76c595c1-516b-4dee-a8c8-1b98f54d5206 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1" status: 200 len: 1268 microversion: 2.1 time: 0.153760 Oct 28 10:00:09.269753 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 553/1123] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:00:09 2021] GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1 => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:10.286262 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-5f20fb7e-06c2-41a2-85c8-911cc94a4ec4 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:10.286862 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-5f20fb7e-06c2-41a2-85c8-911cc94a4ec4 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 535c0fe1-83a7-48c6-b8d5-edb548a9d8a1] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:10.292890 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5f20fb7e-06c2-41a2-85c8-911cc94a4ec4 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:10.293331 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5f20fb7e-06c2-41a2-85c8-911cc94a4ec4 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:10.294078 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5f20fb7e-06c2-41a2-85c8-911cc94a4ec4 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:10.294497 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5f20fb7e-06c2-41a2-85c8-911cc94a4ec4 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:10.417927 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-5f20fb7e-06c2-41a2-85c8-911cc94a4ec4 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:10.425624 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-5f20fb7e-06c2-41a2-85c8-911cc94a4ec4 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1" status: 200 len: 1268 microversion: 2.1 time: 0.143248 Oct 28 10:00:10.426180 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 571/1124] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:00:10 2021] GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1 => generated 1268 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:11.443241 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-9aa2bf13-1d70-461e-9147-a8f3e4236a8d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:11.443839 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-9aa2bf13-1d70-461e-9147-a8f3e4236a8d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 535c0fe1-83a7-48c6-b8d5-edb548a9d8a1] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:11.450069 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9aa2bf13-1d70-461e-9147-a8f3e4236a8d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:11.450517 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9aa2bf13-1d70-461e-9147-a8f3e4236a8d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:11.451287 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9aa2bf13-1d70-461e-9147-a8f3e4236a8d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:11.451718 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9aa2bf13-1d70-461e-9147-a8f3e4236a8d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:11.573176 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-9aa2bf13-1d70-461e-9147-a8f3e4236a8d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:11.581520 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-9aa2bf13-1d70-461e-9147-a8f3e4236a8d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1" status: 200 len: 1268 microversion: 2.1 time: 0.142440 Oct 28 10:00:11.582098 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 554/1125] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:00:11 2021] GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1 => generated 1268 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:12.598790 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-d1fe90e5-f000-4e3c-a567-355c85f9961b tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:12.599402 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-d1fe90e5-f000-4e3c-a567-355c85f9961b tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 535c0fe1-83a7-48c6-b8d5-edb548a9d8a1] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:12.605944 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d1fe90e5-f000-4e3c-a567-355c85f9961b tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:12.606391 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d1fe90e5-f000-4e3c-a567-355c85f9961b tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:12.607159 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d1fe90e5-f000-4e3c-a567-355c85f9961b tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:12.607589 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d1fe90e5-f000-4e3c-a567-355c85f9961b tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:12.736438 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-d1fe90e5-f000-4e3c-a567-355c85f9961b tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:12.744076 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-d1fe90e5-f000-4e3c-a567-355c85f9961b tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1" status: 200 len: 1268 microversion: 2.1 time: 0.149990 Oct 28 10:00:12.744633 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 572/1126] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:00:12 2021] GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1 => generated 1268 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:13.381029 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-6680a77b-c68e-45e8-8442-41a2286eb321 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1604271561", "imageRef": "623b30fc-1d92-46d9-b556-b9b963f3d76c", "flavorRef": "452", "networks": [{"uuid": "205ae73f-5d95-4eea-9d96-d376199c03ff"}]}} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:00:13.432873 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.network.neutron [None req-6680a77b-c68e-45e8-8442-41a2286eb321 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] validate_networks() for [('205ae73f-5d95-4eea-9d96-d376199c03ff', None, None, None, None, None)] {{(pid=123068) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 10:00:13.762121 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-ca73103b-b658-4ad5-b75e-a4ea098b6834 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:13.763305 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-ca73103b-b658-4ad5-b75e-a4ea098b6834 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 535c0fe1-83a7-48c6-b8d5-edb548a9d8a1] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:13.769700 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ca73103b-b658-4ad5-b75e-a4ea098b6834 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:13.770124 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ca73103b-b658-4ad5-b75e-a4ea098b6834 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:13.770950 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ca73103b-b658-4ad5-b75e-a4ea098b6834 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:13.771370 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ca73103b-b658-4ad5-b75e-a4ea098b6834 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:13.801048 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-6680a77b-c68e-45e8-8442-41a2286eb321 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Flavor limits 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:00:13.801468 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-6680a77b-c68e-45e8-8442-41a2286eb321 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Image limits 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:00:13.801935 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-6680a77b-c68e-45e8-8442-41a2286eb321 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Flavor pref 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:00:13.802337 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-6680a77b-c68e-45e8-8442-41a2286eb321 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Image pref 0:0:0 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:00:13.802773 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.virt.hardware [None req-6680a77b-c68e-45e8-8442-41a2286eb321 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:00:13.811579 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6680a77b-c68e-45e8-8442-41a2286eb321 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:13.812019 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6680a77b-c68e-45e8-8442-41a2286eb321 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:13.812864 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6680a77b-c68e-45e8-8442-41a2286eb321 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:13.813289 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-6680a77b-c68e-45e8-8442-41a2286eb321 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:13.831179 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.quota [None req-6680a77b-c68e-45e8-8442-41a2286eb321 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Getting quotas for project 8273ac2aca774a0aa4b6a43247c31c7a. Resources: {'ram', 'cores', 'instances'} {{(pid=123068) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 10:00:13.835215 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.quota [None req-6680a77b-c68e-45e8-8442-41a2286eb321 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Getting quotas for user dbe824ed5ea44570b4127ca6873367c8 and project 8273ac2aca774a0aa4b6a43247c31c7a. Resources: {'ram', 'cores', 'instances'} {{(pid=123068) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 10:00:13.846552 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-6680a77b-c68e-45e8-8442-41a2286eb321 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Going to run 1 instances... {{(pid=123068) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 10:00:13.848935 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-6680a77b-c68e-45e8-8442-41a2286eb321 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: 9176741c-4071-4c65-8518-586a5a98dbfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='623b30fc-1d92-46d9-b556-b9b963f3d76c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123068) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 10:00:13.898072 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-ca73103b-b658-4ad5-b75e-a4ea098b6834 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:13.905684 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-ca73103b-b658-4ad5-b75e-a4ea098b6834 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1" status: 200 len: 1268 microversion: 2.1 time: 0.147375 Oct 28 10:00:13.907424 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 573/1127] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:00:13 2021] GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1 => generated 1268 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:00:13.997459 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-6680a77b-c68e-45e8-8442-41a2286eb321 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.620020 Oct 28 10:00:13.998105 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 555/1128] 10.222.0.104 () {60 vars in 1151 bytes} [Thu Oct 28 10:00:13 2021] POST /compute/v2.1/servers => generated 382 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 28 10:00:14.009667 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-d58f1774-0458-402d-9ad8-d870fb1b9f1b tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:14.010683 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-d58f1774-0458-402d-9ad8-d870fb1b9f1b tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: 9176741c-4071-4c65-8518-586a5a98dbfb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:14.066331 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-d58f1774-0458-402d-9ad8-d870fb1b9f1b tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe824ed5ea44570b4127ca6873367c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8273ac2aca774a0aa4b6a43247c31c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:14.073357 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-d58f1774-0458-402d-9ad8-d870fb1b9f1b tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "GET /compute/v2.1/servers/9176741c-4071-4c65-8518-586a5a98dbfb" status: 200 len: 1223 microversion: 2.1 time: 0.067756 Oct 28 10:00:14.073901 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 574/1129] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:00:14 2021] GET /compute/v2.1/servers/9176741c-4071-4c65-8518-586a5a98dbfb => generated 1223 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:00:14.923935 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-ae8c84f2-b541-449c-81d6-a45ab354cf1b tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:14.924894 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-ae8c84f2-b541-449c-81d6-a45ab354cf1b tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 535c0fe1-83a7-48c6-b8d5-edb548a9d8a1] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:14.931709 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ae8c84f2-b541-449c-81d6-a45ab354cf1b tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:14.938572 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ae8c84f2-b541-449c-81d6-a45ab354cf1b tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:14.938572 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ae8c84f2-b541-449c-81d6-a45ab354cf1b tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:14.938572 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-ae8c84f2-b541-449c-81d6-a45ab354cf1b tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:15.064868 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-ae8c84f2-b541-449c-81d6-a45ab354cf1b tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:15.072171 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-ae8c84f2-b541-449c-81d6-a45ab354cf1b tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1" status: 200 len: 1268 microversion: 2.1 time: 0.152950 Oct 28 10:00:15.072940 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 556/1130] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:00:14 2021] GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1 => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:15.090181 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-29066117-05b0-4f47-a1fd-a3ec5c4ed596 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:15.090783 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-29066117-05b0-4f47-a1fd-a3ec5c4ed596 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: 9176741c-4071-4c65-8518-586a5a98dbfb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:15.097680 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-29066117-05b0-4f47-a1fd-a3ec5c4ed596 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:15.098118 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-29066117-05b0-4f47-a1fd-a3ec5c4ed596 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:15.098880 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-29066117-05b0-4f47-a1fd-a3ec5c4ed596 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:15.099300 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-29066117-05b0-4f47-a1fd-a3ec5c4ed596 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:15.159510 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-29066117-05b0-4f47-a1fd-a3ec5c4ed596 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe824ed5ea44570b4127ca6873367c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8273ac2aca774a0aa4b6a43247c31c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:15.166948 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-29066117-05b0-4f47-a1fd-a3ec5c4ed596 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "GET /compute/v2.1/servers/9176741c-4071-4c65-8518-586a5a98dbfb" status: 200 len: 1227 microversion: 2.1 time: 0.080342 Oct 28 10:00:15.167487 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 575/1131] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:00:15 2021] GET /compute/v2.1/servers/9176741c-4071-4c65-8518-586a5a98dbfb => generated 1227 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:16.089310 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-0dc16b02-7957-4767-9758-3d09e920380e tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:16.090131 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-0dc16b02-7957-4767-9758-3d09e920380e tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 535c0fe1-83a7-48c6-b8d5-edb548a9d8a1] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:16.097634 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0dc16b02-7957-4767-9758-3d09e920380e tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:16.098071 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0dc16b02-7957-4767-9758-3d09e920380e tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:16.098852 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0dc16b02-7957-4767-9758-3d09e920380e tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:16.099275 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0dc16b02-7957-4767-9758-3d09e920380e tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:16.183809 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-248fa8bc-7970-4971-8829-188f6b6982aa tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:16.184545 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-248fa8bc-7970-4971-8829-188f6b6982aa tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: 9176741c-4071-4c65-8518-586a5a98dbfb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:16.192797 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-248fa8bc-7970-4971-8829-188f6b6982aa tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:16.193329 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-248fa8bc-7970-4971-8829-188f6b6982aa tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:16.194328 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-248fa8bc-7970-4971-8829-188f6b6982aa tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:16.194825 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-248fa8bc-7970-4971-8829-188f6b6982aa tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:16.268017 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-248fa8bc-7970-4971-8829-188f6b6982aa tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe824ed5ea44570b4127ca6873367c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8273ac2aca774a0aa4b6a43247c31c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:16.275687 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-248fa8bc-7970-4971-8829-188f6b6982aa tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "GET /compute/v2.1/servers/9176741c-4071-4c65-8518-586a5a98dbfb" status: 200 len: 1283 microversion: 2.1 time: 0.095557 Oct 28 10:00:16.276281 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 576/1132] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:00:16 2021] GET /compute/v2.1/servers/9176741c-4071-4c65-8518-586a5a98dbfb => generated 1283 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:00:16.357070 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-0dc16b02-7957-4767-9758-3d09e920380e tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:16.365235 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-0dc16b02-7957-4767-9758-3d09e920380e tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1" status: 200 len: 1268 microversion: 2.1 time: 0.279562 Oct 28 10:00:16.366329 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 557/1133] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:00:16 2021] GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1 => generated 1268 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:16.385854 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 10:00:16.389357 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: Thu Oct 28 10:00:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 10:00:17.293488 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-f245ab8c-a8cf-45a0-a77f-0661d21596a0 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:17.294031 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-f245ab8c-a8cf-45a0-a77f-0661d21596a0 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: 9176741c-4071-4c65-8518-586a5a98dbfb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:17.301480 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f245ab8c-a8cf-45a0-a77f-0661d21596a0 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:17.307530 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f245ab8c-a8cf-45a0-a77f-0661d21596a0 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:17.307530 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f245ab8c-a8cf-45a0-a77f-0661d21596a0 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:17.307530 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-f245ab8c-a8cf-45a0-a77f-0661d21596a0 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:17.382303 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-01698926-491b-4c15-a8b8-e862aa257836 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:17.383059 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-01698926-491b-4c15-a8b8-e862aa257836 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 535c0fe1-83a7-48c6-b8d5-edb548a9d8a1] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:17.389764 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-01698926-491b-4c15-a8b8-e862aa257836 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:17.390480 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-01698926-491b-4c15-a8b8-e862aa257836 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:17.391574 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-01698926-491b-4c15-a8b8-e862aa257836 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:17.392408 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-01698926-491b-4c15-a8b8-e862aa257836 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:17.497042 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-f245ab8c-a8cf-45a0-a77f-0661d21596a0 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe824ed5ea44570b4127ca6873367c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8273ac2aca774a0aa4b6a43247c31c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:17.504485 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-f245ab8c-a8cf-45a0-a77f-0661d21596a0 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "GET /compute/v2.1/servers/9176741c-4071-4c65-8518-586a5a98dbfb" status: 200 len: 1323 microversion: 2.1 time: 0.214690 Oct 28 10:00:17.505089 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 577/1134] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:00:17 2021] GET /compute/v2.1/servers/9176741c-4071-4c65-8518-586a5a98dbfb => generated 1323 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:17.596250 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-01698926-491b-4c15-a8b8-e862aa257836 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:17.603654 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-01698926-491b-4c15-a8b8-e862aa257836 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1" status: 200 len: 1268 microversion: 2.1 time: 0.224979 Oct 28 10:00:17.604214 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 558/1135] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:00:17 2021] GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1 => generated 1268 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:00:17.868141 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [req-14b9209b-f750-4e37-a25f-96a9fc441e2a req-a8a77b22-1eed-4ec9-9274-8f1ec58ea58a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9176741c-4071-4c65-8518-586a5a98dbfb", "tag": "ec05d4d8-f1e0-49f8-87d1-366a955416cf"}]} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:00:17.869852 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:00:17.869852 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 10:00:17.876837 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-14b9209b-f750-4e37-a25f-96a9fc441e2a req-a8a77b22-1eed-4ec9-9274-8f1ec58ea58a service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:17.879770 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-14b9209b-f750-4e37-a25f-96a9fc441e2a req-a8a77b22-1eed-4ec9-9274-8f1ec58ea58a service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:17.887872 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.compute.server_external_events [req-14b9209b-f750-4e37-a25f-96a9fc441e2a req-a8a77b22-1eed-4ec9-9274-8f1ec58ea58a service nova] Creating event network-changed:ec05d4d8-f1e0-49f8-87d1-366a955416cf for instance 9176741c-4071-4c65-8518-586a5a98dbfb on hv-cinder-81571 Oct 28 10:00:17.893109 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [req-14b9209b-f750-4e37-a25f-96a9fc441e2a req-a8a77b22-1eed-4ec9-9274-8f1ec58ea58a service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029203 Oct 28 10:00:17.893700 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 578/1136] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 10:00:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:00:18.521651 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-d7cf4728-0270-4e11-bacf-6a361d8725f6 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:18.522252 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-d7cf4728-0270-4e11-bacf-6a361d8725f6 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: 9176741c-4071-4c65-8518-586a5a98dbfb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:18.528774 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d7cf4728-0270-4e11-bacf-6a361d8725f6 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:18.529014 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d7cf4728-0270-4e11-bacf-6a361d8725f6 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:18.530154 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d7cf4728-0270-4e11-bacf-6a361d8725f6 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:18.530292 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-d7cf4728-0270-4e11-bacf-6a361d8725f6 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:18.623299 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-cd27c27d-c278-4c23-87fe-c6e776d2e73a tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:18.623810 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-cd27c27d-c278-4c23-87fe-c6e776d2e73a tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 535c0fe1-83a7-48c6-b8d5-edb548a9d8a1] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:18.632188 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-cd27c27d-c278-4c23-87fe-c6e776d2e73a tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:18.632738 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-cd27c27d-c278-4c23-87fe-c6e776d2e73a tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:18.633433 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-cd27c27d-c278-4c23-87fe-c6e776d2e73a tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:18.633871 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-cd27c27d-c278-4c23-87fe-c6e776d2e73a tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:18.664677 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-d7cf4728-0270-4e11-bacf-6a361d8725f6 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe824ed5ea44570b4127ca6873367c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8273ac2aca774a0aa4b6a43247c31c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:18.672029 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-d7cf4728-0270-4e11-bacf-6a361d8725f6 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "GET /compute/v2.1/servers/9176741c-4071-4c65-8518-586a5a98dbfb" status: 200 len: 1323 microversion: 2.1 time: 0.154034 Oct 28 10:00:18.672601 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 559/1137] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:00:18 2021] GET /compute/v2.1/servers/9176741c-4071-4c65-8518-586a5a98dbfb => generated 1323 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:18.763857 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-cd27c27d-c278-4c23-87fe-c6e776d2e73a tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:18.771333 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-cd27c27d-c278-4c23-87fe-c6e776d2e73a tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1" status: 200 len: 1268 microversion: 2.1 time: 0.153686 Oct 28 10:00:18.771902 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 579/1138] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:00:18 2021] GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1 => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:00:19.035412 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-c7c4aa82-afbd-491c-b5fc-d39c79e193b7 req-f440f6b5-c0f1-4713-b31c-5078ed35aef9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "535c0fe1-83a7-48c6-b8d5-edb548a9d8a1", "name": "network-vif-plugged", "status": "completed", "tag": "5f5d6985-145d-4f21-8120-003269e5b4c1"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:00:19.037087 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:00:19.037087 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 10:00:19.044601 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-c7c4aa82-afbd-491c-b5fc-d39c79e193b7 req-f440f6b5-c0f1-4713-b31c-5078ed35aef9 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:19.045073 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-c7c4aa82-afbd-491c-b5fc-d39c79e193b7 req-f440f6b5-c0f1-4713-b31c-5078ed35aef9 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:19.057698 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-c7c4aa82-afbd-491c-b5fc-d39c79e193b7 req-f440f6b5-c0f1-4713-b31c-5078ed35aef9 service nova] Creating event network-vif-plugged:5f5d6985-145d-4f21-8120-003269e5b4c1 for instance 535c0fe1-83a7-48c6-b8d5-edb548a9d8a1 on hv-cinder-81571 Oct 28 10:00:19.062998 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-c7c4aa82-afbd-491c-b5fc-d39c79e193b7 req-f440f6b5-c0f1-4713-b31c-5078ed35aef9 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140276 Oct 28 10:00:19.064189 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 560/1139] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 10:00:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:00:19.690308 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-40220088-9dec-4d26-a261-a228ba6238ae tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:19.690913 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-40220088-9dec-4d26-a261-a228ba6238ae tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: 9176741c-4071-4c65-8518-586a5a98dbfb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:19.697375 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-40220088-9dec-4d26-a261-a228ba6238ae tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:19.697818 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-40220088-9dec-4d26-a261-a228ba6238ae tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:19.698584 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-40220088-9dec-4d26-a261-a228ba6238ae tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:19.699009 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-40220088-9dec-4d26-a261-a228ba6238ae tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:19.788642 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-9878bb37-037b-4986-84f4-f8add8f0d446 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:19.789380 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-9878bb37-037b-4986-84f4-f8add8f0d446 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 535c0fe1-83a7-48c6-b8d5-edb548a9d8a1] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:19.795576 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9878bb37-037b-4986-84f4-f8add8f0d446 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:19.796022 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9878bb37-037b-4986-84f4-f8add8f0d446 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:19.796931 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9878bb37-037b-4986-84f4-f8add8f0d446 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:19.797369 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-9878bb37-037b-4986-84f4-f8add8f0d446 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:19.827834 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-40220088-9dec-4d26-a261-a228ba6238ae tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe824ed5ea44570b4127ca6873367c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8273ac2aca774a0aa4b6a43247c31c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:19.835887 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-40220088-9dec-4d26-a261-a228ba6238ae tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "GET /compute/v2.1/servers/9176741c-4071-4c65-8518-586a5a98dbfb" status: 200 len: 1323 microversion: 2.1 time: 0.149929 Oct 28 10:00:19.836451 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 580/1140] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:00:19 2021] GET /compute/v2.1/servers/9176741c-4071-4c65-8518-586a5a98dbfb => generated 1323 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:19.922357 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-9878bb37-037b-4986-84f4-f8add8f0d446 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:19.930234 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-9878bb37-037b-4986-84f4-f8add8f0d446 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1" status: 200 len: 1268 microversion: 2.1 time: 0.146230 Oct 28 10:00:19.930816 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 561/1141] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:00:19 2021] GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1 => generated 1268 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:00:20.852667 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-e7469e6b-257e-45bb-9cc3-315b2a08cdf1 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:20.859510 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-e7469e6b-257e-45bb-9cc3-315b2a08cdf1 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: 9176741c-4071-4c65-8518-586a5a98dbfb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:20.859928 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e7469e6b-257e-45bb-9cc3-315b2a08cdf1 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:20.860431 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e7469e6b-257e-45bb-9cc3-315b2a08cdf1 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:20.861178 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e7469e6b-257e-45bb-9cc3-315b2a08cdf1 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:20.861595 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e7469e6b-257e-45bb-9cc3-315b2a08cdf1 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:20.947222 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-a0015177-3ae9-4bc8-9176-8d71fcd13488 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:20.947997 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-a0015177-3ae9-4bc8-9176-8d71fcd13488 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 535c0fe1-83a7-48c6-b8d5-edb548a9d8a1] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:20.954840 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a0015177-3ae9-4bc8-9176-8d71fcd13488 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:20.955314 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a0015177-3ae9-4bc8-9176-8d71fcd13488 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:20.956193 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a0015177-3ae9-4bc8-9176-8d71fcd13488 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:20.956669 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a0015177-3ae9-4bc8-9176-8d71fcd13488 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:20.987311 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-e7469e6b-257e-45bb-9cc3-315b2a08cdf1 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe824ed5ea44570b4127ca6873367c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8273ac2aca774a0aa4b6a43247c31c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:20.995043 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-e7469e6b-257e-45bb-9cc3-315b2a08cdf1 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "GET /compute/v2.1/servers/9176741c-4071-4c65-8518-586a5a98dbfb" status: 200 len: 1323 microversion: 2.1 time: 0.146002 Oct 28 10:00:20.995948 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 581/1142] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:00:20 2021] GET /compute/v2.1/servers/9176741c-4071-4c65-8518-586a5a98dbfb => generated 1323 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:21.082071 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-a0015177-3ae9-4bc8-9176-8d71fcd13488 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:21.089538 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-a0015177-3ae9-4bc8-9176-8d71fcd13488 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1" status: 200 len: 1454 microversion: 2.1 time: 0.145948 Oct 28 10:00:21.090108 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 562/1143] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:00:20 2021] GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1 => generated 1454 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:00:21.107087 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-5070e38d-0ff4-4bed-b4ba-12c0457affb1 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:21.107697 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-5070e38d-0ff4-4bed-b4ba-12c0457affb1 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 535c0fe1-83a7-48c6-b8d5-edb548a9d8a1] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:21.113710 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5070e38d-0ff4-4bed-b4ba-12c0457affb1 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:21.114148 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5070e38d-0ff4-4bed-b4ba-12c0457affb1 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:21.114922 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5070e38d-0ff4-4bed-b4ba-12c0457affb1 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:21.115349 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5070e38d-0ff4-4bed-b4ba-12c0457affb1 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:21.236015 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-5070e38d-0ff4-4bed-b4ba-12c0457affb1 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:21.244598 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-5070e38d-0ff4-4bed-b4ba-12c0457affb1 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1" status: 200 len: 1454 microversion: 2.1 time: 0.141192 Oct 28 10:00:21.245227 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 582/1144] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:00:21 2021] GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1 => generated 1454 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:22.015246 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-a79780ae-dd7a-4cae-998f-60235bf8a61a tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:22.016623 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-a79780ae-dd7a-4cae-998f-60235bf8a61a tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: 9176741c-4071-4c65-8518-586a5a98dbfb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:22.029194 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a79780ae-dd7a-4cae-998f-60235bf8a61a tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:22.030176 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a79780ae-dd7a-4cae-998f-60235bf8a61a tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:22.031666 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a79780ae-dd7a-4cae-998f-60235bf8a61a tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:22.032484 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-a79780ae-dd7a-4cae-998f-60235bf8a61a tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:22.355847 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-a79780ae-dd7a-4cae-998f-60235bf8a61a tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe824ed5ea44570b4127ca6873367c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8273ac2aca774a0aa4b6a43247c31c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:22.364782 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-a79780ae-dd7a-4cae-998f-60235bf8a61a tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "GET /compute/v2.1/servers/9176741c-4071-4c65-8518-586a5a98dbfb" status: 200 len: 1323 microversion: 2.1 time: 0.356455 Oct 28 10:00:22.365637 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 563/1145] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:00:22 2021] GET /compute/v2.1/servers/9176741c-4071-4c65-8518-586a5a98dbfb => generated 1323 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:23.388876 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-9c336270-790d-4012-abae-1de66646d607 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:23.389439 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-9c336270-790d-4012-abae-1de66646d607 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: 9176741c-4071-4c65-8518-586a5a98dbfb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:23.397610 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9c336270-790d-4012-abae-1de66646d607 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:23.398109 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9c336270-790d-4012-abae-1de66646d607 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:23.398892 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9c336270-790d-4012-abae-1de66646d607 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:23.399455 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-9c336270-790d-4012-abae-1de66646d607 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:23.719311 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-9c336270-790d-4012-abae-1de66646d607 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe824ed5ea44570b4127ca6873367c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8273ac2aca774a0aa4b6a43247c31c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:23.727498 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-9c336270-790d-4012-abae-1de66646d607 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "GET /compute/v2.1/servers/9176741c-4071-4c65-8518-586a5a98dbfb" status: 200 len: 1323 microversion: 2.1 time: 0.342679 Oct 28 10:00:23.728159 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 583/1146] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:00:23 2021] GET /compute/v2.1/servers/9176741c-4071-4c65-8518-586a5a98dbfb => generated 1323 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:23.914894 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-176aacf5-dfcb-4110-9db5-55c9bdfebbcc req-c81cd293-4f97-47ce-933e-fb39faa8827f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "535c0fe1-83a7-48c6-b8d5-edb548a9d8a1", "tag": "5f5d6985-145d-4f21-8120-003269e5b4c1"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:00:23.916385 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:00:23.916385 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 10:00:23.924604 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-176aacf5-dfcb-4110-9db5-55c9bdfebbcc req-c81cd293-4f97-47ce-933e-fb39faa8827f service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:23.925074 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-176aacf5-dfcb-4110-9db5-55c9bdfebbcc req-c81cd293-4f97-47ce-933e-fb39faa8827f service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:23.939164 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-176aacf5-dfcb-4110-9db5-55c9bdfebbcc req-c81cd293-4f97-47ce-933e-fb39faa8827f service nova] Creating event network-changed:5f5d6985-145d-4f21-8120-003269e5b4c1 for instance 535c0fe1-83a7-48c6-b8d5-edb548a9d8a1 on hv-cinder-81571 Oct 28 10:00:23.944791 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-176aacf5-dfcb-4110-9db5-55c9bdfebbcc req-c81cd293-4f97-47ce-933e-fb39faa8827f service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033495 Oct 28 10:00:23.945697 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 564/1147] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 10:00:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:00:24.746436 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-edf6d89c-6daa-40e0-a7da-b26a3c9f7c6d tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:24.747271 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-edf6d89c-6daa-40e0-a7da-b26a3c9f7c6d tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: 9176741c-4071-4c65-8518-586a5a98dbfb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:24.755734 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-edf6d89c-6daa-40e0-a7da-b26a3c9f7c6d tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:24.756869 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-edf6d89c-6daa-40e0-a7da-b26a3c9f7c6d tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:24.758465 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-edf6d89c-6daa-40e0-a7da-b26a3c9f7c6d tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:24.759451 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-edf6d89c-6daa-40e0-a7da-b26a3c9f7c6d tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:24.955663 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-edf6d89c-6daa-40e0-a7da-b26a3c9f7c6d tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe824ed5ea44570b4127ca6873367c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8273ac2aca774a0aa4b6a43247c31c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:24.968933 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-edf6d89c-6daa-40e0-a7da-b26a3c9f7c6d tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "GET /compute/v2.1/servers/9176741c-4071-4c65-8518-586a5a98dbfb" status: 200 len: 1323 microversion: 2.1 time: 0.226534 Oct 28 10:00:24.971841 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 584/1148] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:00:24 2021] GET /compute/v2.1/servers/9176741c-4071-4c65-8518-586a5a98dbfb => generated 1323 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:25.040270 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-ae501ed3-2dc3-4dec-ba18-5d02daa8630e req-422f54de-fde7-4446-9e9e-943d93a2b3d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9176741c-4071-4c65-8518-586a5a98dbfb", "name": "network-vif-plugged", "status": "completed", "tag": "ec05d4d8-f1e0-49f8-87d1-366a955416cf"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:00:25.042193 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:00:25.042193 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 10:00:25.050654 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-ae501ed3-2dc3-4dec-ba18-5d02daa8630e req-422f54de-fde7-4446-9e9e-943d93a2b3d8 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:25.051185 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-ae501ed3-2dc3-4dec-ba18-5d02daa8630e req-422f54de-fde7-4446-9e9e-943d93a2b3d8 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:25.062630 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-ae501ed3-2dc3-4dec-ba18-5d02daa8630e req-422f54de-fde7-4446-9e9e-943d93a2b3d8 service nova] Creating event network-vif-plugged:ec05d4d8-f1e0-49f8-87d1-366a955416cf for instance 9176741c-4071-4c65-8518-586a5a98dbfb on hv-cinder-81571 Oct 28 10:00:25.068157 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-ae501ed3-2dc3-4dec-ba18-5d02daa8630e req-422f54de-fde7-4446-9e9e-943d93a2b3d8 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032413 Oct 28 10:00:25.069088 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 565/1149] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 10:00:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:00:25.990439 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-68c950ac-9826-44f9-a3cb-a4d2eb78c555 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:25.991090 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-68c950ac-9826-44f9-a3cb-a4d2eb78c555 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: 9176741c-4071-4c65-8518-586a5a98dbfb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:25.997765 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-68c950ac-9826-44f9-a3cb-a4d2eb78c555 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:25.998210 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-68c950ac-9826-44f9-a3cb-a4d2eb78c555 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:25.998986 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-68c950ac-9826-44f9-a3cb-a4d2eb78c555 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:25.999418 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-68c950ac-9826-44f9-a3cb-a4d2eb78c555 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:26.124164 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-68c950ac-9826-44f9-a3cb-a4d2eb78c555 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe824ed5ea44570b4127ca6873367c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8273ac2aca774a0aa4b6a43247c31c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:26.131940 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-68c950ac-9826-44f9-a3cb-a4d2eb78c555 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "GET /compute/v2.1/servers/9176741c-4071-4c65-8518-586a5a98dbfb" status: 200 len: 1323 microversion: 2.1 time: 0.145753 Oct 28 10:00:26.132514 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 585/1150] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:00:25 2021] GET /compute/v2.1/servers/9176741c-4071-4c65-8518-586a5a98dbfb => generated 1323 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:27.150622 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-caa8835c-7442-472d-8e36-6fe74b5f3973 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:27.151270 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-caa8835c-7442-472d-8e36-6fe74b5f3973 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: 9176741c-4071-4c65-8518-586a5a98dbfb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:27.159730 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-caa8835c-7442-472d-8e36-6fe74b5f3973 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:27.160172 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-caa8835c-7442-472d-8e36-6fe74b5f3973 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:27.161063 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-caa8835c-7442-472d-8e36-6fe74b5f3973 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:27.161634 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-caa8835c-7442-472d-8e36-6fe74b5f3973 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:27.306409 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-caa8835c-7442-472d-8e36-6fe74b5f3973 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe824ed5ea44570b4127ca6873367c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8273ac2aca774a0aa4b6a43247c31c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:27.314865 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-caa8835c-7442-472d-8e36-6fe74b5f3973 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "GET /compute/v2.1/servers/9176741c-4071-4c65-8518-586a5a98dbfb" status: 200 len: 1511 microversion: 2.1 time: 0.169227 Oct 28 10:00:27.315599 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 566/1151] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:00:27 2021] GET /compute/v2.1/servers/9176741c-4071-4c65-8518-586a5a98dbfb => generated 1511 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:27.340986 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-5b4abf09-e309-4f46-ace4-dc83252dd5dd tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e15d6c3-9c2f-4dd1-af97-4854328b1b50", "device": "/dev/sdb"}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:00:27.342179 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-5b4abf09-e309-4f46-ace4-dc83252dd5dd tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: 9176741c-4071-4c65-8518-586a5a98dbfb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:27.350185 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5b4abf09-e309-4f46-ace4-dc83252dd5dd tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:27.350618 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5b4abf09-e309-4f46-ace4-dc83252dd5dd tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:27.351399 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5b4abf09-e309-4f46-ace4-dc83252dd5dd tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:27.351821 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-5b4abf09-e309-4f46-ace4-dc83252dd5dd tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:27.972473 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 10:00:27.972757 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: Thu Oct 28 10:00:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9176741c-4071-4c65-8518-586a5a98dbfb/os-volume_attachments (ip 10.222.0.104) !!! Oct 28 10:00:28.091212 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-5b4abf09-e309-4f46-ace4-dc83252dd5dd tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "POST /compute/v2.1/servers/9176741c-4071-4c65-8518-586a5a98dbfb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.754114 Oct 28 10:00:28.091836 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 586/1152] 10.222.0.104 () {60 vars in 1327 bytes} [Thu Oct 28 10:00:27 2021] POST /compute/v2.1/servers/9176741c-4071-4c65-8518-586a5a98dbfb/os-volume_attachments => generated 194 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:00:48.201078 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-bf55aa23-80f6-4e8c-8989-0226b389310d tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:48.201677 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-bf55aa23-80f6-4e8c-8989-0226b389310d tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: 9176741c-4071-4c65-8518-586a5a98dbfb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:48.208220 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bf55aa23-80f6-4e8c-8989-0226b389310d tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:48.208714 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bf55aa23-80f6-4e8c-8989-0226b389310d tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:48.209525 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bf55aa23-80f6-4e8c-8989-0226b389310d tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:48.209960 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bf55aa23-80f6-4e8c-8989-0226b389310d tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:48.293775 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.objects.instance [None req-bf55aa23-80f6-4e8c-8989-0226b389310d tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lazy-loading 'services' on Instance uuid 9176741c-4071-4c65-8518-586a5a98dbfb {{(pid=123068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 10:00:48.574668 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-bf55aa23-80f6-4e8c-8989-0226b389310d tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "DELETE /compute/v2.1/servers/9176741c-4071-4c65-8518-586a5a98dbfb/os-volume_attachments/9e15d6c3-9c2f-4dd1-af97-4854328b1b50" status: 202 len: 0 microversion: 2.1 time: 0.377089 Oct 28 10:00:48.575356 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 567/1153] 10.222.0.104 () {58 vars in 1420 bytes} [Thu Oct 28 10:00:48 2021] DELETE /compute/v2.1/servers/9176741c-4071-4c65-8518-586a5a98dbfb/os-volume_attachments/9e15d6c3-9c2f-4dd1-af97-4854328b1b50 => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:00:49.690879 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-db970c8d-c75b-4ecd-8365-d0f23c182ff6 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:49.694618 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-db970c8d-c75b-4ecd-8365-d0f23c182ff6 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: 9176741c-4071-4c65-8518-586a5a98dbfb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:49.699225 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-db970c8d-c75b-4ecd-8365-d0f23c182ff6 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:49.699711 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-db970c8d-c75b-4ecd-8365-d0f23c182ff6 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:49.700495 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-db970c8d-c75b-4ecd-8365-d0f23c182ff6 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:49.700966 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-db970c8d-c75b-4ecd-8365-d0f23c182ff6 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:49.725731 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-db970c8d-c75b-4ecd-8365-d0f23c182ff6 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: 9176741c-4071-4c65-8518-586a5a98dbfb] Going to try to terminate instance {{(pid=123069) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 10:00:50.049510 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-db970c8d-c75b-4ecd-8365-d0f23c182ff6 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "DELETE /compute/v2.1/servers/9176741c-4071-4c65-8518-586a5a98dbfb" status: 204 len: 0 microversion: 2.1 time: 0.363095 Oct 28 10:00:50.050312 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 587/1154] 10.222.0.104 () {58 vars in 1243 bytes} [Thu Oct 28 10:00:49 2021] DELETE /compute/v2.1/servers/9176741c-4071-4c65-8518-586a5a98dbfb => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:00:50.060028 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-c58db45e-4e7f-4d55-8648-8934890fd3c0 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:50.060757 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-c58db45e-4e7f-4d55-8648-8934890fd3c0 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: 9176741c-4071-4c65-8518-586a5a98dbfb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:50.067848 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c58db45e-4e7f-4d55-8648-8934890fd3c0 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:50.068406 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c58db45e-4e7f-4d55-8648-8934890fd3c0 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:50.069242 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c58db45e-4e7f-4d55-8648-8934890fd3c0 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:50.069676 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c58db45e-4e7f-4d55-8648-8934890fd3c0 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:50.199865 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-c58db45e-4e7f-4d55-8648-8934890fd3c0 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe824ed5ea44570b4127ca6873367c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8273ac2aca774a0aa4b6a43247c31c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:50.207632 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-c58db45e-4e7f-4d55-8648-8934890fd3c0 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "GET /compute/v2.1/servers/9176741c-4071-4c65-8518-586a5a98dbfb" status: 200 len: 1517 microversion: 2.1 time: 0.151577 Oct 28 10:00:50.208391 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 568/1155] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:00:50 2021] GET /compute/v2.1/servers/9176741c-4071-4c65-8518-586a5a98dbfb => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:51.226093 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-d8284c26-85e3-45d4-bf7c-34381e789573 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:51.235630 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-d8284c26-85e3-45d4-bf7c-34381e789573 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: 9176741c-4071-4c65-8518-586a5a98dbfb] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:51.235630 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d8284c26-85e3-45d4-bf7c-34381e789573 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:51.235630 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d8284c26-85e3-45d4-bf7c-34381e789573 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:51.235630 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d8284c26-85e3-45d4-bf7c-34381e789573 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:51.236091 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-d8284c26-85e3-45d4-bf7c-34381e789573 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:51.366911 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-d8284c26-85e3-45d4-bf7c-34381e789573 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe824ed5ea44570b4127ca6873367c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8273ac2aca774a0aa4b6a43247c31c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:51.375810 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-d8284c26-85e3-45d4-bf7c-34381e789573 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "GET /compute/v2.1/servers/9176741c-4071-4c65-8518-586a5a98dbfb" status: 200 len: 1517 microversion: 2.1 time: 0.154308 Oct 28 10:00:51.376391 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 588/1156] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:00:51 2021] GET /compute/v2.1/servers/9176741c-4071-4c65-8518-586a5a98dbfb => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:52.394877 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-0171633e-c101-4e7d-864f-bcd1f6ade9d1 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:52.396099 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-0171633e-c101-4e7d-864f-bcd1f6ade9d1 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: 9176741c-4071-4c65-8518-586a5a98dbfb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:52.402560 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0171633e-c101-4e7d-864f-bcd1f6ade9d1 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:52.402996 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0171633e-c101-4e7d-864f-bcd1f6ade9d1 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:52.403774 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0171633e-c101-4e7d-864f-bcd1f6ade9d1 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:52.404199 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0171633e-c101-4e7d-864f-bcd1f6ade9d1 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:52.462606 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [req-d32c61c3-db0c-41be-9727-fccf45364a29 req-c254a045-63d2-4008-8eb5-e98400636235 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9176741c-4071-4c65-8518-586a5a98dbfb", "name": "network-vif-deleted", "tag": "ec05d4d8-f1e0-49f8-87d1-366a955416cf"}]} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:00:52.466988 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:00:52.466988 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 10:00:52.472159 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-d32c61c3-db0c-41be-9727-fccf45364a29 req-c254a045-63d2-4008-8eb5-e98400636235 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:52.472597 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-d32c61c3-db0c-41be-9727-fccf45364a29 req-c254a045-63d2-4008-8eb5-e98400636235 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:52.479159 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-0171633e-c101-4e7d-864f-bcd1f6ade9d1 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe824ed5ea44570b4127ca6873367c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8273ac2aca774a0aa4b6a43247c31c7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:52.484029 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.compute.server_external_events [req-d32c61c3-db0c-41be-9727-fccf45364a29 req-c254a045-63d2-4008-8eb5-e98400636235 service nova] Creating event network-vif-deleted:ec05d4d8-f1e0-49f8-87d1-366a955416cf for instance 9176741c-4071-4c65-8518-586a5a98dbfb on hv-cinder-81571 Oct 28 10:00:52.487380 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-0171633e-c101-4e7d-864f-bcd1f6ade9d1 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "GET /compute/v2.1/servers/9176741c-4071-4c65-8518-586a5a98dbfb" status: 200 len: 1475 microversion: 2.1 time: 0.096418 Oct 28 10:00:52.488141 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 569/1157] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:00:52 2021] GET /compute/v2.1/servers/9176741c-4071-4c65-8518-586a5a98dbfb => generated 1475 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:52.489703 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [req-d32c61c3-db0c-41be-9727-fccf45364a29 req-c254a045-63d2-4008-8eb5-e98400636235 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031582 Oct 28 10:00:52.490425 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 589/1158] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 10:00:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:00:53.505278 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-c11defad-9e1c-4181-abef-f6113f253987 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:53.505929 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-c11defad-9e1c-4181-abef-f6113f253987 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] [instance: 9176741c-4071-4c65-8518-586a5a98dbfb] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:00:53.512397 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c11defad-9e1c-4181-abef-f6113f253987 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:53.512956 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c11defad-9e1c-4181-abef-f6113f253987 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:53.513728 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c11defad-9e1c-4181-abef-f6113f253987 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:00:53.514153 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c11defad-9e1c-4181-abef-f6113f253987 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:00:53.528367 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.wsgi [None req-c11defad-9e1c-4181-abef-f6113f253987 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] HTTP exception thrown: Instance 9176741c-4071-4c65-8518-586a5a98dbfb could not be found. Oct 28 10:00:53.529014 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-c11defad-9e1c-4181-abef-f6113f253987 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] Returning 404 to user: Instance 9176741c-4071-4c65-8518-586a5a98dbfb could not be found. {{(pid=123068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 10:00:53.529851 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-c11defad-9e1c-4181-abef-f6113f253987 tempest-VolumesSnapshotTestJSON-215695244 tempest-VolumesSnapshotTestJSON-215695244-project] 10.222.0.104 "GET /compute/v2.1/servers/9176741c-4071-4c65-8518-586a5a98dbfb" status: 404 len: 111 microversion: 2.1 time: 0.028424 Oct 28 10:00:53.530411 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 570/1159] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:00:53 2021] GET /compute/v2.1/servers/9176741c-4071-4c65-8518-586a5a98dbfb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:01:57.082619 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 10:01:57.083586 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: Thu Oct 28 10:01:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 10:02:12.782253 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-b6aae8d4-9eaf-45e3-aba7-4ff286d80f60 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1552830473", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-87968533", "security_groups": [{"name": "tempest-secgroup-smoke-1252555229"}], "block_device_mapping_v2": [{"uuid": "fe9531bf-549c-43ea-bf5c-6dc0db9e9dde", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5478037d-e561-4e8b-811e-6f93ca4dff8e"}]}} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:12.936523 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.network.neutron [None req-b6aae8d4-9eaf-45e3-aba7-4ff286d80f60 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] validate_networks() for [('5478037d-e561-4e8b-811e-6f93ca4dff8e', None, None, None, None, None)] {{(pid=123069) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 28 10:02:13.550657 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-b6aae8d4-9eaf-45e3-aba7-4ff286d80f60 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Flavor limits 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:02:13.551086 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-b6aae8d4-9eaf-45e3-aba7-4ff286d80f60 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Image limits 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:02:13.551701 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-b6aae8d4-9eaf-45e3-aba7-4ff286d80f60 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Flavor pref 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:02:13.552112 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-b6aae8d4-9eaf-45e3-aba7-4ff286d80f60 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Image pref 0:0:0 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:02:13.552522 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.virt.hardware [None req-b6aae8d4-9eaf-45e3-aba7-4ff286d80f60 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123069) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:02:13.562686 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b6aae8d4-9eaf-45e3-aba7-4ff286d80f60 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:02:13.563127 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b6aae8d4-9eaf-45e3-aba7-4ff286d80f60 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:02:13.563924 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b6aae8d4-9eaf-45e3-aba7-4ff286d80f60 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:02:13.564353 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-b6aae8d4-9eaf-45e3-aba7-4ff286d80f60 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:02:13.584374 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.quota [None req-b6aae8d4-9eaf-45e3-aba7-4ff286d80f60 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Getting quotas for project 8891d4ce726f4b84a18cbb3bce4e53c3. Resources: {'ram', 'cores', 'instances'} {{(pid=123069) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 28 10:02:13.589548 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.quota [None req-b6aae8d4-9eaf-45e3-aba7-4ff286d80f60 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Getting quotas for user c6c7a9975b554c30956dcd3d34b93a97 and project 8891d4ce726f4b84a18cbb3bce4e53c3. Resources: {'ram', 'cores', 'instances'} {{(pid=123069) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 28 10:02:13.661411 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-b6aae8d4-9eaf-45e3-aba7-4ff286d80f60 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Going to run 1 instances... {{(pid=123069) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 28 10:02:13.661411 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-b6aae8d4-9eaf-45e3-aba7-4ff286d80f60 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 50017f57-0db5-44f0-a09a-bd8810ad07c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fe9531bf-549c-43ea-bf5c-6dc0db9e9dde',volume_size=None,volume_type=None)] {{(pid=123069) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 28 10:02:14.108450 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-b6aae8d4-9eaf-45e3-aba7-4ff286d80f60 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.334341 Oct 28 10:02:14.110606 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 590/1160] 10.222.0.104 () {60 vars in 1151 bytes} [Thu Oct 28 10:02:12 2021] POST /compute/v2.1/servers => generated 408 bytes in 1336 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 28 10:02:14.123385 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: ERROR oslo.messaging._drivers.impl_rabbit [-] [173c4f05-96e3-4535-a18a-21ab7d79b711] AMQP server on 10.222.0.104:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 10:02:14.127322 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-05cd4c55-0f91-43b4-b4b9-a0f2fdac6165 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:14.127934 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-05cd4c55-0f91-43b4-b4b9-a0f2fdac6165 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 50017f57-0db5-44f0-a09a-bd8810ad07c4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:02:14.212171 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-05cd4c55-0f91-43b4-b4b9-a0f2fdac6165 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:14.223655 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-05cd4c55-0f91-43b4-b4b9-a0f2fdac6165 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4" status: 200 len: 1096 microversion: 2.1 time: 0.104863 Oct 28 10:02:14.234052 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 571/1161] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:02:14 2021] GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4 => generated 1096 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:15.243159 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-0176ac21-788f-4001-a285-c05c9ce09b5e tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:15.243769 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-0176ac21-788f-4001-a285-c05c9ce09b5e tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 50017f57-0db5-44f0-a09a-bd8810ad07c4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:02:15.256373 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0176ac21-788f-4001-a285-c05c9ce09b5e tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:02:15.256373 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0176ac21-788f-4001-a285-c05c9ce09b5e tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:02:15.256373 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0176ac21-788f-4001-a285-c05c9ce09b5e tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:02:15.256373 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-0176ac21-788f-4001-a285-c05c9ce09b5e tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:02:15.316906 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-0176ac21-788f-4001-a285-c05c9ce09b5e tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:15.325358 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-0176ac21-788f-4001-a285-c05c9ce09b5e tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4" status: 200 len: 1146 microversion: 2.1 time: 0.086828 Oct 28 10:02:15.326107 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 591/1162] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:02:15 2021] GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4 => generated 1146 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:16.343456 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-4d3ee1c5-8a6d-4b2b-a0f5-6353faaf7aac tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:16.344111 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-4d3ee1c5-8a6d-4b2b-a0f5-6353faaf7aac tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 50017f57-0db5-44f0-a09a-bd8810ad07c4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:02:16.362473 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4d3ee1c5-8a6d-4b2b-a0f5-6353faaf7aac tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:02:16.364523 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4d3ee1c5-8a6d-4b2b-a0f5-6353faaf7aac tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:02:16.364523 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4d3ee1c5-8a6d-4b2b-a0f5-6353faaf7aac tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:02:16.364523 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-4d3ee1c5-8a6d-4b2b-a0f5-6353faaf7aac tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:02:16.370325 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO oslo.messaging._drivers.impl_rabbit [-] [173c4f05-96e3-4535-a18a-21ab7d79b711] Reconnected to AMQP server on 10.222.0.104:5672 via [amqp] client with port 42776. Oct 28 10:02:16.467320 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-4d3ee1c5-8a6d-4b2b-a0f5-6353faaf7aac tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:16.479381 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-4d3ee1c5-8a6d-4b2b-a0f5-6353faaf7aac tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4" status: 200 len: 1202 microversion: 2.1 time: 0.139908 Oct 28 10:02:16.486980 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 572/1163] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:02:16 2021] GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4 => generated 1202 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:17.500066 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-69823b24-dfde-493f-b00b-a5358645c61d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:17.501612 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-69823b24-dfde-493f-b00b-a5358645c61d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 50017f57-0db5-44f0-a09a-bd8810ad07c4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:02:17.509951 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-69823b24-dfde-493f-b00b-a5358645c61d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:02:17.511531 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-69823b24-dfde-493f-b00b-a5358645c61d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:02:17.512393 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-69823b24-dfde-493f-b00b-a5358645c61d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:02:17.512867 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-69823b24-dfde-493f-b00b-a5358645c61d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:02:17.785295 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-69823b24-dfde-493f-b00b-a5358645c61d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:17.793466 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-69823b24-dfde-493f-b00b-a5358645c61d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4" status: 200 len: 1280 microversion: 2.1 time: 0.299415 Oct 28 10:02:17.794350 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 592/1164] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:02:17 2021] GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4 => generated 1280 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:18.602892 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-5d0f48ff-eddc-4868-9a3f-38dbeba6ef5b req-c44da38a-9bc7-42c9-b3bb-2d85160a92c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50017f57-0db5-44f0-a09a-bd8810ad07c4", "tag": "fc7b947c-a4ba-4e69-bb2b-622c17670eb6"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:18.605637 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:02:18.605637 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 10:02:18.612955 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-5d0f48ff-eddc-4868-9a3f-38dbeba6ef5b req-c44da38a-9bc7-42c9-b3bb-2d85160a92c3 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:02:18.613395 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-5d0f48ff-eddc-4868-9a3f-38dbeba6ef5b req-c44da38a-9bc7-42c9-b3bb-2d85160a92c3 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:02:18.781814 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-5d0f48ff-eddc-4868-9a3f-38dbeba6ef5b req-c44da38a-9bc7-42c9-b3bb-2d85160a92c3 service nova] Creating event network-changed:fc7b947c-a4ba-4e69-bb2b-622c17670eb6 for instance 50017f57-0db5-44f0-a09a-bd8810ad07c4 on hv-cinder-81571 Oct 28 10:02:18.787983 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-5d0f48ff-eddc-4868-9a3f-38dbeba6ef5b req-c44da38a-9bc7-42c9-b3bb-2d85160a92c3 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.393043 Oct 28 10:02:18.787983 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 573/1165] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 10:02:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:18.818671 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-e1cc78f3-56bf-4785-8a19-3c667a74302d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:18.819272 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-e1cc78f3-56bf-4785-8a19-3c667a74302d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 50017f57-0db5-44f0-a09a-bd8810ad07c4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:02:18.825741 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e1cc78f3-56bf-4785-8a19-3c667a74302d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:02:18.826184 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e1cc78f3-56bf-4785-8a19-3c667a74302d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:02:18.826972 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e1cc78f3-56bf-4785-8a19-3c667a74302d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:02:18.827403 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-e1cc78f3-56bf-4785-8a19-3c667a74302d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:02:19.029843 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-e1cc78f3-56bf-4785-8a19-3c667a74302d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:19.037388 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-e1cc78f3-56bf-4785-8a19-3c667a74302d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4" status: 200 len: 1268 microversion: 2.1 time: 0.223149 Oct 28 10:02:19.038820 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 593/1166] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:02:18 2021] GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4 => generated 1268 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:20.056429 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-036b0e76-a487-4a25-a191-8f0eb62a3233 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:20.058583 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-036b0e76-a487-4a25-a191-8f0eb62a3233 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 50017f57-0db5-44f0-a09a-bd8810ad07c4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:02:20.064782 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-036b0e76-a487-4a25-a191-8f0eb62a3233 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:02:20.065225 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-036b0e76-a487-4a25-a191-8f0eb62a3233 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:02:20.066027 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-036b0e76-a487-4a25-a191-8f0eb62a3233 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:02:20.066452 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-036b0e76-a487-4a25-a191-8f0eb62a3233 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:02:20.195856 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-036b0e76-a487-4a25-a191-8f0eb62a3233 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:20.204219 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-036b0e76-a487-4a25-a191-8f0eb62a3233 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4" status: 200 len: 1268 microversion: 2.1 time: 0.151658 Oct 28 10:02:20.206789 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 574/1167] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:02:20 2021] GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4 => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:21.221744 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-379a0215-cd1d-435e-9c10-9f5393b4c3f2 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:21.222397 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-379a0215-cd1d-435e-9c10-9f5393b4c3f2 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 50017f57-0db5-44f0-a09a-bd8810ad07c4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:02:21.228643 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-379a0215-cd1d-435e-9c10-9f5393b4c3f2 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:02:21.229173 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-379a0215-cd1d-435e-9c10-9f5393b4c3f2 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:02:21.229970 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-379a0215-cd1d-435e-9c10-9f5393b4c3f2 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:02:21.230392 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-379a0215-cd1d-435e-9c10-9f5393b4c3f2 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:02:21.363040 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-379a0215-cd1d-435e-9c10-9f5393b4c3f2 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:21.371213 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-379a0215-cd1d-435e-9c10-9f5393b4c3f2 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4" status: 200 len: 1268 microversion: 2.1 time: 0.153562 Oct 28 10:02:21.371783 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 594/1168] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:02:21 2021] GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4 => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:22.388307 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-fae9bcf8-0dbc-4f32-8e10-904b2696d309 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:22.389122 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-fae9bcf8-0dbc-4f32-8e10-904b2696d309 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 50017f57-0db5-44f0-a09a-bd8810ad07c4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:02:22.395547 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fae9bcf8-0dbc-4f32-8e10-904b2696d309 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:02:22.395987 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fae9bcf8-0dbc-4f32-8e10-904b2696d309 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:02:22.396789 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fae9bcf8-0dbc-4f32-8e10-904b2696d309 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:02:22.397217 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fae9bcf8-0dbc-4f32-8e10-904b2696d309 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:02:22.545663 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-fae9bcf8-0dbc-4f32-8e10-904b2696d309 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:22.554113 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-fae9bcf8-0dbc-4f32-8e10-904b2696d309 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4" status: 200 len: 1268 microversion: 2.1 time: 0.170389 Oct 28 10:02:22.554689 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 575/1169] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:02:22 2021] GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4 => generated 1268 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:23.571284 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-ba5abd5e-94db-42dd-a92f-62b62ef25ffc tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:23.571884 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-ba5abd5e-94db-42dd-a92f-62b62ef25ffc tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 50017f57-0db5-44f0-a09a-bd8810ad07c4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:02:23.578551 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ba5abd5e-94db-42dd-a92f-62b62ef25ffc tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:02:23.578982 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ba5abd5e-94db-42dd-a92f-62b62ef25ffc tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:02:23.579774 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ba5abd5e-94db-42dd-a92f-62b62ef25ffc tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:02:23.580191 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-ba5abd5e-94db-42dd-a92f-62b62ef25ffc tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:02:23.710636 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-ba5abd5e-94db-42dd-a92f-62b62ef25ffc tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:23.719993 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-ba5abd5e-94db-42dd-a92f-62b62ef25ffc tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4" status: 200 len: 1268 microversion: 2.1 time: 0.152089 Oct 28 10:02:23.720573 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 595/1170] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:02:23 2021] GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4 => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:24.739181 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-e2f691f9-df53-4ca5-812a-3ac3a041eefd tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:24.739792 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-e2f691f9-df53-4ca5-812a-3ac3a041eefd tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 50017f57-0db5-44f0-a09a-bd8810ad07c4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:02:24.746792 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e2f691f9-df53-4ca5-812a-3ac3a041eefd tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:02:24.747231 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e2f691f9-df53-4ca5-812a-3ac3a041eefd tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:02:24.748015 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e2f691f9-df53-4ca5-812a-3ac3a041eefd tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:02:24.748449 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e2f691f9-df53-4ca5-812a-3ac3a041eefd tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:02:24.874843 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-e2f691f9-df53-4ca5-812a-3ac3a041eefd tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:24.886908 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-e2f691f9-df53-4ca5-812a-3ac3a041eefd tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4" status: 200 len: 1268 microversion: 2.1 time: 0.151675 Oct 28 10:02:24.887479 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 576/1171] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:02:24 2021] GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4 => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:25.903872 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-697e66fa-2a38-44b3-aef0-7b26e295c3b4 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:25.904459 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-697e66fa-2a38-44b3-aef0-7b26e295c3b4 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 50017f57-0db5-44f0-a09a-bd8810ad07c4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:02:25.912317 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-697e66fa-2a38-44b3-aef0-7b26e295c3b4 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:02:25.912826 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-697e66fa-2a38-44b3-aef0-7b26e295c3b4 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:02:25.913631 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-697e66fa-2a38-44b3-aef0-7b26e295c3b4 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:02:25.914063 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-697e66fa-2a38-44b3-aef0-7b26e295c3b4 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:02:26.051942 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-697e66fa-2a38-44b3-aef0-7b26e295c3b4 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:26.061291 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-697e66fa-2a38-44b3-aef0-7b26e295c3b4 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4" status: 200 len: 1268 microversion: 2.1 time: 0.161285 Oct 28 10:02:26.061884 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 596/1172] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:02:25 2021] GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4 => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:27.079008 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-26f034d4-1c6a-45b3-97ab-6eb1f1434c4d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:27.079613 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-26f034d4-1c6a-45b3-97ab-6eb1f1434c4d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 50017f57-0db5-44f0-a09a-bd8810ad07c4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:02:27.086111 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-26f034d4-1c6a-45b3-97ab-6eb1f1434c4d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:02:27.086617 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-26f034d4-1c6a-45b3-97ab-6eb1f1434c4d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:02:27.087514 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-26f034d4-1c6a-45b3-97ab-6eb1f1434c4d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:02:27.088393 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-26f034d4-1c6a-45b3-97ab-6eb1f1434c4d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:02:27.220037 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-26f034d4-1c6a-45b3-97ab-6eb1f1434c4d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:27.228002 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-26f034d4-1c6a-45b3-97ab-6eb1f1434c4d tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4" status: 200 len: 1268 microversion: 2.1 time: 0.152595 Oct 28 10:02:27.228641 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 577/1173] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:02:27 2021] GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4 => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:28.248278 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-4c63190e-4512-4913-aed6-2e3f39bb5111 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:28.249085 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-4c63190e-4512-4913-aed6-2e3f39bb5111 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 50017f57-0db5-44f0-a09a-bd8810ad07c4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:02:28.257425 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4c63190e-4512-4913-aed6-2e3f39bb5111 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:02:28.257880 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4c63190e-4512-4913-aed6-2e3f39bb5111 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:02:28.258877 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4c63190e-4512-4913-aed6-2e3f39bb5111 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:02:28.259112 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4c63190e-4512-4913-aed6-2e3f39bb5111 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:02:28.410603 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-4c63190e-4512-4913-aed6-2e3f39bb5111 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:28.419104 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-4c63190e-4512-4913-aed6-2e3f39bb5111 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4" status: 200 len: 1268 microversion: 2.1 time: 0.177123 Oct 28 10:02:28.426139 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 597/1174] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:02:28 2021] GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4 => generated 1268 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:29.435802 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-8bd36dc4-28c9-4ccf-a4f7-7773be60d9ba tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:29.436449 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-8bd36dc4-28c9-4ccf-a4f7-7773be60d9ba tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 50017f57-0db5-44f0-a09a-bd8810ad07c4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:02:29.442789 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8bd36dc4-28c9-4ccf-a4f7-7773be60d9ba tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:02:29.443227 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8bd36dc4-28c9-4ccf-a4f7-7773be60d9ba tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:02:29.444018 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8bd36dc4-28c9-4ccf-a4f7-7773be60d9ba tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:02:29.444451 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-8bd36dc4-28c9-4ccf-a4f7-7773be60d9ba tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:02:29.578561 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-8bd36dc4-28c9-4ccf-a4f7-7773be60d9ba tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:29.591775 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-8bd36dc4-28c9-4ccf-a4f7-7773be60d9ba tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4" status: 200 len: 1268 microversion: 2.1 time: 0.160211 Oct 28 10:02:29.592367 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 578/1175] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:02:29 2021] GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4 => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:29.678140 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [req-f13119c5-5a7b-4967-9bb0-0c7d48210c5e req-a742b0b2-a0db-4179-b287-c62dbc03c7d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50017f57-0db5-44f0-a09a-bd8810ad07c4", "name": "network-vif-plugged", "status": "completed", "tag": "fc7b947c-a4ba-4e69-bb2b-622c17670eb6"}]} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:29.680437 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:02:29.680437 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 10:02:29.687889 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-f13119c5-5a7b-4967-9bb0-0c7d48210c5e req-a742b0b2-a0db-4179-b287-c62dbc03c7d7 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:02:29.688336 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-f13119c5-5a7b-4967-9bb0-0c7d48210c5e req-a742b0b2-a0db-4179-b287-c62dbc03c7d7 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:02:29.699512 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.compute.server_external_events [req-f13119c5-5a7b-4967-9bb0-0c7d48210c5e req-a742b0b2-a0db-4179-b287-c62dbc03c7d7 service nova] Creating event network-vif-plugged:fc7b947c-a4ba-4e69-bb2b-622c17670eb6 for instance 50017f57-0db5-44f0-a09a-bd8810ad07c4 on hv-cinder-81571 Oct 28 10:02:29.704558 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [req-f13119c5-5a7b-4967-9bb0-0c7d48210c5e req-a742b0b2-a0db-4179-b287-c62dbc03c7d7 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030274 Oct 28 10:02:29.710328 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 598/1176] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 10:02:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:30.608942 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-7d079818-6204-448f-82da-78fb65ccd056 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:30.609602 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-7d079818-6204-448f-82da-78fb65ccd056 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 50017f57-0db5-44f0-a09a-bd8810ad07c4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:02:30.616484 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7d079818-6204-448f-82da-78fb65ccd056 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:02:30.616964 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7d079818-6204-448f-82da-78fb65ccd056 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:02:30.617745 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7d079818-6204-448f-82da-78fb65ccd056 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:02:30.618314 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-7d079818-6204-448f-82da-78fb65ccd056 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:02:30.745019 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-7d079818-6204-448f-82da-78fb65ccd056 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:30.752601 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-7d079818-6204-448f-82da-78fb65ccd056 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4" status: 200 len: 1268 microversion: 2.1 time: 0.147760 Oct 28 10:02:30.753191 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 579/1177] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:02:30 2021] GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4 => generated 1268 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:31.770184 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-fd3de361-55ff-4b20-9fc0-a4ebd45ca8c8 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:31.770951 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-fd3de361-55ff-4b20-9fc0-a4ebd45ca8c8 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 50017f57-0db5-44f0-a09a-bd8810ad07c4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:02:31.777188 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fd3de361-55ff-4b20-9fc0-a4ebd45ca8c8 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:02:31.777628 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fd3de361-55ff-4b20-9fc0-a4ebd45ca8c8 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:02:31.778398 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fd3de361-55ff-4b20-9fc0-a4ebd45ca8c8 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:02:31.778847 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-fd3de361-55ff-4b20-9fc0-a4ebd45ca8c8 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:02:31.904084 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-fd3de361-55ff-4b20-9fc0-a4ebd45ca8c8 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:31.911482 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-fd3de361-55ff-4b20-9fc0-a4ebd45ca8c8 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4" status: 200 len: 1454 microversion: 2.1 time: 0.145845 Oct 28 10:02:31.912054 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 599/1178] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:02:31 2021] GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4 => generated 1454 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:31.929955 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-bf0eb88f-97fc-439f-aaf1-562c0e78a09f tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:31.930557 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-bf0eb88f-97fc-439f-aaf1-562c0e78a09f tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 50017f57-0db5-44f0-a09a-bd8810ad07c4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:02:31.938436 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bf0eb88f-97fc-439f-aaf1-562c0e78a09f tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:02:31.938875 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bf0eb88f-97fc-439f-aaf1-562c0e78a09f tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:02:31.939653 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bf0eb88f-97fc-439f-aaf1-562c0e78a09f tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:02:31.940079 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-bf0eb88f-97fc-439f-aaf1-562c0e78a09f tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:02:32.063791 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-bf0eb88f-97fc-439f-aaf1-562c0e78a09f tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:32.071165 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-bf0eb88f-97fc-439f-aaf1-562c0e78a09f tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4" status: 200 len: 1454 microversion: 2.1 time: 0.145050 Oct 28 10:02:32.071729 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 580/1179] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:02:31 2021] GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4 => generated 1454 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:34.029548 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [req-5b44dae8-54be-4b41-8e5a-53b5e28009df req-95387b29-bbb9-469d-b7a2-6ddfabad620c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50017f57-0db5-44f0-a09a-bd8810ad07c4", "tag": "fc7b947c-a4ba-4e69-bb2b-622c17670eb6"}]} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:34.030888 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:02:34.030888 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 10:02:34.038093 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-5b44dae8-54be-4b41-8e5a-53b5e28009df req-95387b29-bbb9-469d-b7a2-6ddfabad620c service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:02:34.038600 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-5b44dae8-54be-4b41-8e5a-53b5e28009df req-95387b29-bbb9-469d-b7a2-6ddfabad620c service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:02:34.050585 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.compute.server_external_events [req-5b44dae8-54be-4b41-8e5a-53b5e28009df req-95387b29-bbb9-469d-b7a2-6ddfabad620c service nova] Creating event network-changed:fc7b947c-a4ba-4e69-bb2b-622c17670eb6 for instance 50017f57-0db5-44f0-a09a-bd8810ad07c4 on hv-cinder-81571 Oct 28 10:02:34.055709 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [req-5b44dae8-54be-4b41-8e5a-53b5e28009df req-95387b29-bbb9-469d-b7a2-6ddfabad620c service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034260 Oct 28 10:02:34.056299 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 600/1180] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 10:02:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:03:30.222868 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 10:03:30.223514 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: Thu Oct 28 10:03:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 10:03:36.404308 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 10:03:36.405100 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: Thu Oct 28 10:03:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 10:04:02.776464 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-eaa73c45-4eb0-4eb1-984f-da195e1e5975 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:02.777823 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-eaa73c45-4eb0-4eb1-984f-da195e1e5975 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 50017f57-0db5-44f0-a09a-bd8810ad07c4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:04:02.779900 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [req-c44295c1-4e7f-476b-ab52-3b6f8e19ca06 req-1bffe5e5-c629-4b33-bd85-62774fee20cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50017f57-0db5-44f0-a09a-bd8810ad07c4", "tag": "fc7b947c-a4ba-4e69-bb2b-622c17670eb6"}]} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:02.781534 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:04:02.781534 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 10:04:02.785016 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-eaa73c45-4eb0-4eb1-984f-da195e1e5975 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:04:02.785787 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-eaa73c45-4eb0-4eb1-984f-da195e1e5975 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:04:02.786595 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-eaa73c45-4eb0-4eb1-984f-da195e1e5975 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:04:02.787258 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-eaa73c45-4eb0-4eb1-984f-da195e1e5975 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:04:02.789665 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-c44295c1-4e7f-476b-ab52-3b6f8e19ca06 req-1bffe5e5-c629-4b33-bd85-62774fee20cb service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:04:02.790339 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-c44295c1-4e7f-476b-ab52-3b6f8e19ca06 req-1bffe5e5-c629-4b33-bd85-62774fee20cb service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:04:02.802158 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.compute.server_external_events [req-c44295c1-4e7f-476b-ab52-3b6f8e19ca06 req-1bffe5e5-c629-4b33-bd85-62774fee20cb service nova] Creating event network-changed:fc7b947c-a4ba-4e69-bb2b-622c17670eb6 for instance 50017f57-0db5-44f0-a09a-bd8810ad07c4 on hv-cinder-81571 Oct 28 10:04:02.807428 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [req-c44295c1-4e7f-476b-ab52-3b6f8e19ca06 req-1bffe5e5-c629-4b33-bd85-62774fee20cb service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033091 Oct 28 10:04:02.808392 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 601/1181] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 10:04:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:04:02.822459 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-eaa73c45-4eb0-4eb1-984f-da195e1e5975 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 50017f57-0db5-44f0-a09a-bd8810ad07c4] Going to try to terminate instance {{(pid=123068) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 10:04:03.239833 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-eaa73c45-4eb0-4eb1-984f-da195e1e5975 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "DELETE /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4" status: 204 len: 0 microversion: 2.1 time: 0.469578 Oct 28 10:04:03.240797 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 581/1182] 10.222.0.104 () {58 vars in 1243 bytes} [Thu Oct 28 10:04:02 2021] DELETE /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:04:03.249660 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-c8b3de74-1eab-4083-a76d-9f2cdf88e518 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:03.250552 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-c8b3de74-1eab-4083-a76d-9f2cdf88e518 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 50017f57-0db5-44f0-a09a-bd8810ad07c4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:04:03.258396 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c8b3de74-1eab-4083-a76d-9f2cdf88e518 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:04:03.258814 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c8b3de74-1eab-4083-a76d-9f2cdf88e518 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:04:03.259860 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c8b3de74-1eab-4083-a76d-9f2cdf88e518 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:04:03.260525 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-c8b3de74-1eab-4083-a76d-9f2cdf88e518 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:04:03.530140 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-c8b3de74-1eab-4083-a76d-9f2cdf88e518 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:03.540132 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-c8b3de74-1eab-4083-a76d-9f2cdf88e518 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4" status: 200 len: 1579 microversion: 2.1 time: 0.294316 Oct 28 10:04:03.540951 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 602/1183] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:04:03 2021] GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4 => generated 1579 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:04.563961 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-0d5c0995-baff-4472-826c-5f910cfeb432 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:04.564744 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-0d5c0995-baff-4472-826c-5f910cfeb432 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 50017f57-0db5-44f0-a09a-bd8810ad07c4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:04:04.572317 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0d5c0995-baff-4472-826c-5f910cfeb432 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:04:04.572858 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0d5c0995-baff-4472-826c-5f910cfeb432 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:04:04.573763 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0d5c0995-baff-4472-826c-5f910cfeb432 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:04:04.574265 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-0d5c0995-baff-4472-826c-5f910cfeb432 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:04:04.765738 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-0d5c0995-baff-4472-826c-5f910cfeb432 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:04.773932 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-0d5c0995-baff-4472-826c-5f910cfeb432 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4" status: 200 len: 1460 microversion: 2.1 time: 0.214049 Oct 28 10:04:04.774528 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 582/1184] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:04:04 2021] GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4 => generated 1460 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:05.602540 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [req-8d0f3f69-0380-4712-980d-65830bf47d0e req-9f6b7862-aab2-4155-a7b8-cbe603c779b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50017f57-0db5-44f0-a09a-bd8810ad07c4", "name": "network-vif-deleted", "tag": "fc7b947c-a4ba-4e69-bb2b-622c17670eb6"}]} {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:05.604339 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:04:05.604339 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: warnings.warn(msg) Oct 28 10:04:05.612845 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-8d0f3f69-0380-4712-980d-65830bf47d0e req-9f6b7862-aab2-4155-a7b8-cbe603c779b5 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:04:05.613275 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [req-8d0f3f69-0380-4712-980d-65830bf47d0e req-9f6b7862-aab2-4155-a7b8-cbe603c779b5 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:04:05.625958 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.compute.server_external_events [req-8d0f3f69-0380-4712-980d-65830bf47d0e req-9f6b7862-aab2-4155-a7b8-cbe603c779b5 service nova] Creating event network-vif-deleted:fc7b947c-a4ba-4e69-bb2b-622c17670eb6 for instance 50017f57-0db5-44f0-a09a-bd8810ad07c4 on hv-cinder-81571 Oct 28 10:04:05.631867 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [req-8d0f3f69-0380-4712-980d-65830bf47d0e req-9f6b7862-aab2-4155-a7b8-cbe603c779b5 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032983 Oct 28 10:04:05.632465 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 603/1185] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 10:04:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:04:05.791270 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-860ad876-fc52-4d38-bb09-5e43ef7f24f4 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:05.792019 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-860ad876-fc52-4d38-bb09-5e43ef7f24f4 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 50017f57-0db5-44f0-a09a-bd8810ad07c4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:04:05.798646 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-860ad876-fc52-4d38-bb09-5e43ef7f24f4 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:04:05.799009 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-860ad876-fc52-4d38-bb09-5e43ef7f24f4 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:04:05.799777 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-860ad876-fc52-4d38-bb09-5e43ef7f24f4 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:04:05.800200 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-860ad876-fc52-4d38-bb09-5e43ef7f24f4 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:04:05.867455 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-860ad876-fc52-4d38-bb09-5e43ef7f24f4 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:05.878146 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-860ad876-fc52-4d38-bb09-5e43ef7f24f4 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4" status: 200 len: 1227 microversion: 2.1 time: 0.090779 Oct 28 10:04:05.879119 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 583/1186] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:04:05 2021] GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4 => generated 1227 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:06.897185 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-95cc14e2-4fe9-4e97-abb2-0891a52e4e23 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:06.897980 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-95cc14e2-4fe9-4e97-abb2-0891a52e4e23 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 50017f57-0db5-44f0-a09a-bd8810ad07c4] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:04:06.904789 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-95cc14e2-4fe9-4e97-abb2-0891a52e4e23 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:04:06.905238 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-95cc14e2-4fe9-4e97-abb2-0891a52e4e23 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:04:06.906069 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-95cc14e2-4fe9-4e97-abb2-0891a52e4e23 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:04:06.906515 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-95cc14e2-4fe9-4e97-abb2-0891a52e4e23 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:04:06.951063 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-95cc14e2-4fe9-4e97-abb2-0891a52e4e23 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:04:06.951603 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-95cc14e2-4fe9-4e97-abb2-0891a52e4e23 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:04:06.952062 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.objects.instance [None req-95cc14e2-4fe9-4e97-abb2-0891a52e4e23 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lazy-loading 'fault' on Instance uuid 50017f57-0db5-44f0-a09a-bd8810ad07c4 {{(pid=123069) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 28 10:04:06.999330 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-95cc14e2-4fe9-4e97-abb2-0891a52e4e23 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:07.009851 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-95cc14e2-4fe9-4e97-abb2-0891a52e4e23 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4" status: 200 len: 1232 microversion: 2.1 time: 0.118191 Oct 28 10:04:07.020454 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 604/1187] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:04:06 2021] GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4 => generated 1232 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:08.028614 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-e56950cf-de11-42e2-ab1a-578bc3f350b7 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:08.029278 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-e56950cf-de11-42e2-ab1a-578bc3f350b7 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 50017f57-0db5-44f0-a09a-bd8810ad07c4] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:04:08.035785 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e56950cf-de11-42e2-ab1a-578bc3f350b7 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:04:08.036229 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e56950cf-de11-42e2-ab1a-578bc3f350b7 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:04:08.037203 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e56950cf-de11-42e2-ab1a-578bc3f350b7 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:04:08.037643 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-e56950cf-de11-42e2-ab1a-578bc3f350b7 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:04:08.051631 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.wsgi [None req-e56950cf-de11-42e2-ab1a-578bc3f350b7 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] HTTP exception thrown: Instance 50017f57-0db5-44f0-a09a-bd8810ad07c4 could not be found. Oct 28 10:04:08.052238 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-e56950cf-de11-42e2-ab1a-578bc3f350b7 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Returning 404 to user: Instance 50017f57-0db5-44f0-a09a-bd8810ad07c4 could not be found. {{(pid=123068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 10:04:08.053143 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-e56950cf-de11-42e2-ab1a-578bc3f350b7 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4" status: 404 len: 111 microversion: 2.1 time: 0.028337 Oct 28 10:04:08.053696 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 584/1188] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:04:08 2021] GET /compute/v2.1/servers/50017f57-0db5-44f0-a09a-bd8810ad07c4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:04:11.917266 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-88f5042f-f8d1-4d2d-a731-a05056875bd5 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:11.922920 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-88f5042f-f8d1-4d2d-a731-a05056875bd5 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 535c0fe1-83a7-48c6-b8d5-edb548a9d8a1] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:04:11.923082 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-21f056df-b8de-4205-aee1-0fd67c46d8ce req-75bf8d5e-69af-4d87-9e1f-ded2876141ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "535c0fe1-83a7-48c6-b8d5-edb548a9d8a1", "tag": "5f5d6985-145d-4f21-8120-003269e5b4c1"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:11.923082 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:04:11.923082 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 10:04:11.924382 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-88f5042f-f8d1-4d2d-a731-a05056875bd5 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:04:11.925115 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-88f5042f-f8d1-4d2d-a731-a05056875bd5 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:04:11.925893 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-88f5042f-f8d1-4d2d-a731-a05056875bd5 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:04:11.926530 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-88f5042f-f8d1-4d2d-a731-a05056875bd5 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:04:11.929918 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-21f056df-b8de-4205-aee1-0fd67c46d8ce req-75bf8d5e-69af-4d87-9e1f-ded2876141ea service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:04:11.930361 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-21f056df-b8de-4205-aee1-0fd67c46d8ce req-75bf8d5e-69af-4d87-9e1f-ded2876141ea service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:04:11.942606 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-21f056df-b8de-4205-aee1-0fd67c46d8ce req-75bf8d5e-69af-4d87-9e1f-ded2876141ea service nova] Creating event network-changed:5f5d6985-145d-4f21-8120-003269e5b4c1 for instance 535c0fe1-83a7-48c6-b8d5-edb548a9d8a1 on hv-cinder-81571 Oct 28 10:04:11.948171 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-21f056df-b8de-4205-aee1-0fd67c46d8ce req-75bf8d5e-69af-4d87-9e1f-ded2876141ea service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031278 Oct 28 10:04:11.949422 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 585/1189] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 10:04:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:04:11.955568 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-88f5042f-f8d1-4d2d-a731-a05056875bd5 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 535c0fe1-83a7-48c6-b8d5-edb548a9d8a1] Going to try to terminate instance {{(pid=123069) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 28 10:04:12.412634 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-88f5042f-f8d1-4d2d-a731-a05056875bd5 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "DELETE /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1" status: 204 len: 0 microversion: 2.1 time: 0.497932 Oct 28 10:04:12.414270 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 605/1190] 10.222.0.104 () {58 vars in 1243 bytes} [Thu Oct 28 10:04:11 2021] DELETE /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:04:12.439905 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-fd17ff07-9aef-4619-8e35-a6e23a613886 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:12.440773 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-fd17ff07-9aef-4619-8e35-a6e23a613886 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 535c0fe1-83a7-48c6-b8d5-edb548a9d8a1] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:04:12.451370 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fd17ff07-9aef-4619-8e35-a6e23a613886 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:04:12.452838 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fd17ff07-9aef-4619-8e35-a6e23a613886 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:04:12.454817 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fd17ff07-9aef-4619-8e35-a6e23a613886 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:04:12.455447 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-fd17ff07-9aef-4619-8e35-a6e23a613886 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:04:12.648787 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.policy [None req-fd17ff07-9aef-4619-8e35-a6e23a613886 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123068) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:12.657083 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-fd17ff07-9aef-4619-8e35-a6e23a613886 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1" status: 200 len: 1579 microversion: 2.1 time: 0.229602 Oct 28 10:04:12.658013 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 586/1191] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:04:12 2021] GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1 => generated 1579 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:13.675725 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-4165ebc2-b71d-42e4-b90a-37d98e977eee tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:13.676429 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-4165ebc2-b71d-42e4-b90a-37d98e977eee tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 535c0fe1-83a7-48c6-b8d5-edb548a9d8a1] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:04:13.683774 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4165ebc2-b71d-42e4-b90a-37d98e977eee tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:04:13.684221 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4165ebc2-b71d-42e4-b90a-37d98e977eee tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:04:13.685025 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4165ebc2-b71d-42e4-b90a-37d98e977eee tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:04:13.685460 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-4165ebc2-b71d-42e4-b90a-37d98e977eee tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:04:13.808489 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-4165ebc2-b71d-42e4-b90a-37d98e977eee tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:13.815832 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-4165ebc2-b71d-42e4-b90a-37d98e977eee tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1" status: 200 len: 1460 microversion: 2.1 time: 0.144198 Oct 28 10:04:13.816403 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 606/1192] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:04:13 2021] GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1 => generated 1460 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:14.530927 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [req-1dfcd672-8bc8-4ee6-91c5-f2904755e4db req-b4aa9016-b411-4f51-ad7a-6b4b0d6bbc97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "535c0fe1-83a7-48c6-b8d5-edb548a9d8a1", "name": "network-vif-deleted", "tag": "5f5d6985-145d-4f21-8120-003269e5b4c1"}]} {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:14.532421 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 10:04:14.532421 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: warnings.warn(msg) Oct 28 10:04:14.540156 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-1dfcd672-8bc8-4ee6-91c5-f2904755e4db req-b4aa9016-b411-4f51-ad7a-6b4b0d6bbc97 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:04:14.546193 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [req-1dfcd672-8bc8-4ee6-91c5-f2904755e4db req-b4aa9016-b411-4f51-ad7a-6b4b0d6bbc97 service nova] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:04:14.552075 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.compute.server_external_events [req-1dfcd672-8bc8-4ee6-91c5-f2904755e4db req-b4aa9016-b411-4f51-ad7a-6b4b0d6bbc97 service nova] Creating event network-vif-deleted:5f5d6985-145d-4f21-8120-003269e5b4c1 for instance 535c0fe1-83a7-48c6-b8d5-edb548a9d8a1 on hv-cinder-81571 Oct 28 10:04:14.558191 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [req-1dfcd672-8bc8-4ee6-91c5-f2904755e4db req-b4aa9016-b411-4f51-ad7a-6b4b0d6bbc97 service nova] 10.222.0.104 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030838 Oct 28 10:04:14.558926 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 587/1193] 10.222.0.104 () {64 vars in 1322 bytes} [Thu Oct 28 10:04:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:04:14.833895 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-048fbec5-a01d-43c4-8b84-27de158ebfd1 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:14.834662 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-048fbec5-a01d-43c4-8b84-27de158ebfd1 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 535c0fe1-83a7-48c6-b8d5-edb548a9d8a1] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:04:14.841357 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-048fbec5-a01d-43c4-8b84-27de158ebfd1 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:04:14.841947 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-048fbec5-a01d-43c4-8b84-27de158ebfd1 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:04:14.842806 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-048fbec5-a01d-43c4-8b84-27de158ebfd1 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:04:14.843423 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-048fbec5-a01d-43c4-8b84-27de158ebfd1 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:04:14.918081 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.policy [None req-048fbec5-a01d-43c4-8b84-27de158ebfd1 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c7a9975b554c30956dcd3d34b93a97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8891d4ce726f4b84a18cbb3bce4e53c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123069) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:14.937786 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-048fbec5-a01d-43c4-8b84-27de158ebfd1 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1" status: 200 len: 1227 microversion: 2.1 time: 0.102186 Oct 28 10:04:14.937786 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 607/1194] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:04:14 2021] GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1 => generated 1227 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:15.951602 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-c7e79dda-4b06-4e93-b71c-7596d63fafc4 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:15.952288 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-c7e79dda-4b06-4e93-b71c-7596d63fafc4 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 535c0fe1-83a7-48c6-b8d5-edb548a9d8a1] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:04:15.958687 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c7e79dda-4b06-4e93-b71c-7596d63fafc4 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:04:15.961185 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c7e79dda-4b06-4e93-b71c-7596d63fafc4 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:04:15.961185 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c7e79dda-4b06-4e93-b71c-7596d63fafc4 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:04:15.961185 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-c7e79dda-4b06-4e93-b71c-7596d63fafc4 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:04:15.973487 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.wsgi [None req-c7e79dda-4b06-4e93-b71c-7596d63fafc4 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] HTTP exception thrown: Instance 535c0fe1-83a7-48c6-b8d5-edb548a9d8a1 could not be found. Oct 28 10:04:15.974080 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-c7e79dda-4b06-4e93-b71c-7596d63fafc4 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Returning 404 to user: Instance 535c0fe1-83a7-48c6-b8d5-edb548a9d8a1 could not be found. {{(pid=123068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 10:04:15.975495 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-c7e79dda-4b06-4e93-b71c-7596d63fafc4 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1" status: 404 len: 111 microversion: 2.1 time: 0.027776 Oct 28 10:04:15.975495 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 588/1195] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:04:15 2021] GET /compute/v2.1/servers/535c0fe1-83a7-48c6-b8d5-edb548a9d8a1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:04:16.486027 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-7557e11d-7156-4139-967b-a1bd8d91d999 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:16.486574 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.compute.api [None req-7557e11d-7156-4139-967b-a1bd8d91d999 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 0d8c7f9d-ae44-4516-a430-e19cf05cda9f] Fetching instance by UUID {{(pid=123069) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:04:16.493068 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7557e11d-7156-4139-967b-a1bd8d91d999 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:04:16.493528 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7557e11d-7156-4139-967b-a1bd8d91d999 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:04:16.494314 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7557e11d-7156-4139-967b-a1bd8d91d999 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:04:16.494739 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG oslo_concurrency.lockutils [None req-7557e11d-7156-4139-967b-a1bd8d91d999 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123069) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:04:16.508358 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.wsgi [None req-7557e11d-7156-4139-967b-a1bd8d91d999 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] HTTP exception thrown: Instance 0d8c7f9d-ae44-4516-a430-e19cf05cda9f could not be found. Oct 28 10:04:16.508991 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-7557e11d-7156-4139-967b-a1bd8d91d999 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Returning 404 to user: Instance 0d8c7f9d-ae44-4516-a430-e19cf05cda9f could not be found. {{(pid=123069) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 10:04:16.509817 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-7557e11d-7156-4139-967b-a1bd8d91d999 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "DELETE /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f" status: 404 len: 111 microversion: 2.1 time: 0.027511 Oct 28 10:04:16.510372 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 608/1196] 10.222.0.104 () {58 vars in 1243 bytes} [Thu Oct 28 10:04:16 2021] DELETE /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:04:16.518592 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-86f975ce-0272-4fed-b1c9-97d8dd000973 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '>' {{(pid=123068) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:16.519202 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.compute.api [None req-86f975ce-0272-4fed-b1c9-97d8dd000973 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] [instance: 0d8c7f9d-ae44-4516-a430-e19cf05cda9f] Fetching instance by UUID {{(pid=123068) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 28 10:04:16.525803 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-86f975ce-0272-4fed-b1c9-97d8dd000973 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:04:16.526245 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-86f975ce-0272-4fed-b1c9-97d8dd000973 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:04:16.527017 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-86f975ce-0272-4fed-b1c9-97d8dd000973 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 28 10:04:16.527475 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG oslo_concurrency.lockutils [None req-86f975ce-0272-4fed-b1c9-97d8dd000973 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Lock "356e6bf2-a214-4629-b73a-1cdeb48ef84c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123068) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 28 10:04:16.541503 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.wsgi [None req-86f975ce-0272-4fed-b1c9-97d8dd000973 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] HTTP exception thrown: Instance 0d8c7f9d-ae44-4516-a430-e19cf05cda9f could not be found. Oct 28 10:04:16.542091 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: DEBUG nova.api.openstack.wsgi [None req-86f975ce-0272-4fed-b1c9-97d8dd000973 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Returning 404 to user: Instance 0d8c7f9d-ae44-4516-a430-e19cf05cda9f could not be found. {{(pid=123068) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 28 10:04:16.542915 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO nova.api.openstack.requestlog [None req-86f975ce-0272-4fed-b1c9-97d8dd000973 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f" status: 404 len: 111 microversion: 2.1 time: 0.028205 Oct 28 10:04:16.543456 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: [pid: 123068|app: 0|req: 589/1197] 10.222.0.104 () {58 vars in 1240 bytes} [Thu Oct 28 10:04:16 2021] GET /compute/v2.1/servers/0d8c7f9d-ae44-4516-a430-e19cf05cda9f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:04:18.084132 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: DEBUG nova.api.openstack.wsgi [None req-86be309d-6bcb-4500-94f1-a62e9acdf6a4 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] Calling method '.version_select at 0x7fe121608a60>' {{(pid=123069) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:18.171377 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO nova.api.openstack.requestlog [None req-86be309d-6bcb-4500-94f1-a62e9acdf6a4 tempest-TestVolumeBootPattern-1040868839 tempest-TestVolumeBootPattern-1040868839-project] 10.222.0.104 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-87968533" status: 202 len: 0 microversion: 2.1 time: 0.090986 Oct 28 10:04:18.171959 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: [pid: 123069|app: 0|req: 609/1198] 10.222.0.104 () {58 vars in 1261 bytes} [Thu Oct 28 10:04:18 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-87968533 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:05:27.993410 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 10:05:27.994137 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: Thu Oct 28 10:05:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 10:06:50.240773 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 10:06:50.241572 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: Thu Oct 28 10:06:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 10:06:56.421213 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 10:06:56.421936 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: Thu Oct 28 10:06:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 10:06:57.103288 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 10:06:57.103879 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: Thu Oct 28 10:06:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 10:07:04.918746 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 10:07:04.919369 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: Thu Oct 28 10:07:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 10:07:20.411657 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 10:07:20.412329 dv-cinder-815712-3-iscsi devstack@n-api.service[123068]: Thu Oct 28 10:07:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 28 10:08:48.013892 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 10:08:48.014542 dv-cinder-815712-3-iscsi devstack@n-api.service[123069]: Thu Oct 28 10:08:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!